Nov 10 19:11:56 user nova-compute[75026]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75026) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 19:11:56 user nova-compute[75026]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75026) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 19:11:56 user nova-compute[75026]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75026) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 19:11:56 user nova-compute[75026]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 10 19:11:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:11:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:11:56 user nova-compute[75026]: INFO nova.virt.driver [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 10 19:11:57 user nova-compute[75026]: INFO nova.compute.provider_config [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] Acquiring lock "singleton_lock" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] Acquired lock "singleton_lock" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] Releasing lock "singleton_lock" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] Full set of CONF: {{(pid=75026) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ******************************************************************************** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] Configuration options gathered from: {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ================================================================================ {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] allow_resize_to_same_host      = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] arq_binding_timeout            = 300 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] backdoor_port                  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] backdoor_socket                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] block_device_allocate_retries  = 300 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] block_device_allocate_retries_interval = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cert                           = self.pem {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute_monitors               = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] config_dir                     = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] config_drive_format            = iso9660 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] config_source                  = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] console_host                   = user {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] control_exchange               = nova {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cpu_allocation_ratio           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] daemon                         = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] debug                          = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] default_access_ip_network_name = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] default_availability_zone      = nova {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] default_ephemeral_format       = ext4 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] default_green_pool_size        = 1000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] default_schedule_zone          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] disk_allocation_ratio          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] enable_new_services            = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] enabled_ssl_apis               = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] flat_injected                  = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] force_config_drive             = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] force_raw_images               = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] graceful_shutdown_timeout      = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] heal_instance_info_cache_interval = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] host                           = user {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] instance_build_timeout         = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] instance_delete_interval       = 300 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] instance_name_template         = instance-%08x {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] instance_usage_audit           = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] instance_usage_audit_period    = month {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] internal_service_availability_zone = internal {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] key                            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] live_migration_retry_count     = 30 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] log_config_append              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] log_dir                        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] log_file                       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] log_options                    = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] log_rotate_interval            = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] log_rotate_interval_type       = days {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] log_rotation_type              = none {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] long_rpc_timeout               = 1800 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] max_concurrent_builds          = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] max_concurrent_live_migrations = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] max_concurrent_snapshots       = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] max_local_block_devices        = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] max_logfile_count              = 30 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] max_logfile_size_mb            = 200 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] maximum_instance_delete_attempts = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] metadata_listen                = 0.0.0.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] metadata_listen_port           = 8775 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] metadata_workers               = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] migrate_max_retries            = -1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] mkisofs_cmd                    = genisoimage {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] my_ip                          = 10.0.0.210 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] network_allocate_retries       = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] osapi_compute_listen_port      = 8774 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] osapi_compute_unique_server_name_scope =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] osapi_compute_workers          = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] password_length                = 12 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] periodic_enable                = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] periodic_fuzzy_delay           = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] pointer_model                  = ps2mouse {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] preallocate_images             = none {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] publish_errors                 = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] pybasedir                      = /opt/stack/nova {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ram_allocation_ratio           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] rate_limit_burst               = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] rate_limit_except_level        = CRITICAL {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] rate_limit_interval            = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] reboot_timeout                 = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] reclaim_instance_interval      = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] record                         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] reimage_timeout_per_gb         = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] report_interval                = 120 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] rescue_timeout                 = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] reserved_host_cpus             = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] reserved_host_disk_mb          = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] reserved_host_memory_mb        = 512 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] reserved_huge_pages            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] resize_confirm_window          = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] resize_fs_using_block_device   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] resume_guests_state_on_host_boot = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] rpc_response_timeout           = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] run_external_periodic_tasks    = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] running_deleted_instance_action = reap {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] running_deleted_instance_timeout = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler_instance_sync_interval = 120 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_down_time              = 720 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] servicegroup_driver            = db {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] shelved_offload_time           = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] shelved_poll_interval          = 3600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] shutdown_timeout               = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] source_is_ipv6                 = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ssl_only                       = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] state_path                     = /opt/stack/data/nova {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] sync_power_state_interval      = 600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] sync_power_state_pool_size     = 1000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] syslog_log_facility            = LOG_USER {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] tempdir                        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] timeout_nbd                    = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] transport_url                  = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] update_resources_interval      = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] use_cow_images                 = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] use_eventlog                   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] use_journal                    = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] use_json                       = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] use_rootwrap_daemon            = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] use_stderr                     = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] use_syslog                     = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vcpu_pin_set                   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plugging_is_fatal          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plugging_timeout           = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] virt_mkfs                      = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] volume_usage_poll_interval     = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] watch_log_file                 = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] web                            = /usr/share/spice-html5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_concurrency.disable_process_locking = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.auth_strategy              = keystone {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.compute_link_prefix        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.dhcp_domain                = novalocal {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.enable_instance_password   = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.glance_link_prefix         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.instance_list_per_project_cells = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.list_records_by_skipping_down_cells = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.local_metadata_per_cell    = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.max_limit                  = 1000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.metadata_cache_expiration  = 15 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.neutron_default_tenant_id  = default {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.use_forwarded_for          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.use_neutron_default_nets   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.vendordata_dynamic_targets = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.vendordata_jsonfile_path   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.backend_argument         = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.config_prefix            = cache.oslo {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.dead_timeout             = 60.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.debug_cache_backend      = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.enable_retry_client      = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.enable_socket_keepalive  = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.enabled                  = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.expiration_time          = 600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.hashclient_retry_attempts = 2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_dead_retry      = 300 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_password        =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_sasl_enabled    = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.memcache_username        =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.proxies                  = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.retry_attempts           = 2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.retry_delay              = 0.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.socket_keepalive_count   = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.socket_keepalive_idle    = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.socket_keepalive_interval = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.tls_allowed_ciphers      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.tls_cafile               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.tls_certfile             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.tls_enabled              = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cache.tls_keyfile              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.auth_section            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.auth_type               = password {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.cafile                  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.certfile                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.collect_timing          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.cross_az_attach         = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.debug                   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.endpoint_template       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.http_retries            = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.insecure                = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.keyfile                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.os_region_name          = RegionOne {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.split_loggers           = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cinder.timeout                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.cpu_dedicated_set      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.cpu_shared_set         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.image_type_exclude_list = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.resource_provider_association_refresh = 300 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.shutdown_retry_interval = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] conductor.workers              = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] console.allowed_origins        = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] console.ssl_ciphers            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] console.ssl_minimum_version    = default {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] consoleauth.token_ttl          = 600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.cafile                  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.certfile                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.collect_timing          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.connect_retries         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.connect_retry_delay     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.endpoint_override       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.insecure                = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.keyfile                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.max_version             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.min_version             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.region_name             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.service_name            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.service_type            = accelerator {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.split_loggers           = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.status_code_retries     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.status_code_retry_delay = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.timeout                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] cyborg.version                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.backend               = sqlalchemy {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.connection            = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.connection_debug      = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.connection_parameters =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.connection_recycle_time = 3600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.connection_trace      = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.db_inc_retry_interval = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.db_max_retries        = 20 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.db_max_retry_interval = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.db_retry_interval     = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.max_overflow          = 50 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.max_pool_size         = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.max_retries           = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.mysql_wsrep_sync_wait = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.pool_timeout          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.retry_interval        = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.slave_connection      = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] database.sqlite_synchronous    = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.backend           = sqlalchemy {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.connection        = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.connection_debug  = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.connection_parameters =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.connection_recycle_time = 3600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.connection_trace  = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.db_inc_retry_interval = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.db_max_retries    = 20 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.db_max_retry_interval = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.db_retry_interval = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.max_overflow      = 50 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.max_pool_size     = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.max_retries       = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.pool_timeout      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.retry_interval    = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.slave_connection  = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] api_database.sqlite_synchronous = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] devices.enabled_mdev_types     = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ephemeral_storage_encryption.enabled = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.api_servers             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.cafile                  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.certfile                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.collect_timing          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.connect_retries         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.connect_retry_delay     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.debug                   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.default_trusted_certificate_ids = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.enable_certificate_validation = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.enable_rbd_download     = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.endpoint_override       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.insecure                = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.keyfile                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.max_version             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.min_version             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.num_retries             = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.rbd_ceph_conf           =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.rbd_connect_timeout     = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.rbd_pool                =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.rbd_user                =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.region_name             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.service_name            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.service_type            = image {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.split_loggers           = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.status_code_retries     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.status_code_retry_delay = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.timeout                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.verify_glance_signatures = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] glance.version                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] guestfs.debug                  = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.config_drive_cdrom      = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.config_drive_inject_password = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.enable_remotefx         = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.instances_path_share    =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.limit_cpu_features      = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.use_multipath_io        = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.vswitch_name            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] mks.enabled                    = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] image_cache.manager_interval   = 2400 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] image_cache.precache_concurrency = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] image_cache.remove_unused_base_images = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] image_cache.subdirectory_name  = _base {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.api_max_retries         = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.api_retry_interval      = 2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.auth_section            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.auth_type               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.cafile                  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.certfile                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.collect_timing          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.conductor_group         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.connect_retries         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.connect_retry_delay     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.endpoint_override       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.insecure                = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.keyfile                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.max_version             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.min_version             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.peer_list               = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.region_name             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.serial_console_state_timeout = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.service_name            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.service_type            = baremetal {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.split_loggers           = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.status_code_retries     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.status_code_retry_delay = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.timeout                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ironic.version                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] key_manager.fixed_key          = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.barbican_api_version  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.barbican_endpoint     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.barbican_endpoint_type = public {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.barbican_region_name  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.cafile                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.certfile              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.collect_timing        = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.insecure              = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.keyfile               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.number_of_retries     = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.retry_delay           = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.send_service_user_token = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.split_loggers         = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.timeout               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.verify_ssl            = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican.verify_ssl_path       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.auth_section = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.auth_type = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.cafile   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.certfile = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.collect_timing = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.insecure = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.keyfile  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.split_loggers = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] barbican_service_user.timeout  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.approle_role_id          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.approle_secret_id        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.cafile                   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.certfile                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.collect_timing           = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.insecure                 = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.keyfile                  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.kv_mountpoint            = secret {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.kv_path                  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.kv_version               = 2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.namespace                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.root_token_id            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.split_loggers            = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.ssl_ca_crt_file          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.timeout                  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.use_ssl                  = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.auth_section          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.auth_type             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.cafile                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.certfile              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.collect_timing        = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.connect_retries       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.connect_retry_delay   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.endpoint_override     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.insecure              = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.keyfile               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.max_version           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.min_version           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.region_name           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.service_name          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.service_type          = identity {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.split_loggers         = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.status_code_retries   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.status_code_retry_delay = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.timeout               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] keystone.version               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.connection_uri         =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.cpu_mode               = custom {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: WARNING oslo_config.cfg [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.cpu_power_governor_high = performance {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.cpu_power_management   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.device_detach_attempts = 8 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.device_detach_timeout  = 20 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.disk_cachemodes        = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.disk_prefix            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.enabled_perf_events    = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.file_backed_memory     = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.gid_maps               = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.hw_disk_discard        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.hw_machine_type        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.images_rbd_pool        = rbd {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.images_type            = default {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.images_volume_group    = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.inject_key             = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.inject_partition       = -2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.inject_password        = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.iscsi_iface            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.iser_use_multipath     = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_downtime = 500 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_inbound_addr = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_scheme  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_timeout_action = abort {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_tunnelled = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: WARNING oslo_config.cfg [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 10 19:11:57 user nova-compute[75026]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 10 19:11:57 user nova-compute[75026]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 10 19:11:57 user nova-compute[75026]: and ``live_migration_inbound_addr`` respectively.
Nov 10 19:11:57 user nova-compute[75026]: ).  Its value may be silently ignored in the future.
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.live_migration_with_native_tls = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.max_queues             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.nfs_mount_options      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.num_pcie_ports         = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.pmem_namespaces        = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.quobyte_client_cfg     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rbd_secret_uuid        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rbd_user               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rescue_image_id        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rescue_kernel_id       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.rx_queue_size          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.smbfs_mount_options    =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.snapshot_compression   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.snapshot_image_format  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.sparse_logical_volumes = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.swtpm_enabled          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.swtpm_group            = tss {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.swtpm_user             = tss {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.sysinfo_serial         = unique {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.tb_cache_size          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.tx_queue_size          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.uid_maps               = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.use_virtio_for_bridges = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.virt_type              = kvm {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.volume_clear           = zero {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.volume_clear_size      = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.volume_use_multipath   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.vzstorage_cache_path   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.auth_section           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.auth_type              = password {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.cafile                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.certfile               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.collect_timing         = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.connect_retries        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.connect_retry_delay    = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.default_floating_pool  = public {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.endpoint_override      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.extension_sync_interval = 600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.http_retries           = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.insecure               = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.keyfile                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.max_version            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.min_version            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.ovs_bridge             = br-int {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.physnets               = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.region_name            = RegionOne {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.service_metadata_proxy = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.service_name           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.service_type           = network {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.split_loggers          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.status_code_retries    = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.status_code_retry_delay = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.timeout                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] neutron.version                = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] notifications.bdms_in_notifications = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] notifications.default_level    = INFO {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] notifications.notification_format = unversioned {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] notifications.notify_on_state_change = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] pci.alias                      = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] pci.device_spec                = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] pci.report_in_placement        = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.auth_section         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.auth_type            = password {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.cafile               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.certfile             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.collect_timing       = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.connect_retries      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.connect_retry_delay  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.default_domain_id    = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.default_domain_name  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.domain_id            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.domain_name          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.endpoint_override    = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.insecure             = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.keyfile              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.max_version          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.min_version          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.password             = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.project_domain_id    = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.project_domain_name  = Default {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.project_id           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.project_name         = service {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.region_name          = RegionOne {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.service_name         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.service_type         = placement {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.split_loggers        = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.status_code_retries  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.status_code_retry_delay = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.system_scope         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.timeout              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.trust_id             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.user_domain_id       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.user_domain_name     = Default {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.user_id              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.username             = placement {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] placement.version              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.cores                    = 20 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.count_usage_from_placement = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.injected_file_content_bytes = 10240 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.injected_file_path_length = 255 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.injected_files           = 5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.instances                = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.key_pairs                = 100 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.metadata_items           = 128 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.ram                      = 51200 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.recheck_quota            = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.server_group_members     = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] quota.server_groups            = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] rdp.enabled                    = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.image_metadata_prefilter = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.max_attempts         = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.max_placement_results = 1000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] scheduler.workers              = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.host_subset_size = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.isolated_hosts = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.isolated_images = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.pci_in_placement = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.track_instance_changes = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] metrics.required               = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] metrics.weight_multiplier      = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] metrics.weight_setting         = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] serial_console.enabled         = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] serial_console.port_range      = 10000:20000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] serial_console.serialproxy_port = 6083 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.auth_section      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.auth_type         = password {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.cafile            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.certfile          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.collect_timing    = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.insecure          = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.keyfile           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.send_service_user_token = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.split_loggers     = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] service_user.timeout           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.agent_enabled            = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.enabled                  = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.html5proxy_port          = 6082 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.image_compression        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.jpeg_compression         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.playback_compression     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.server_listen            = 127.0.0.1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.streaming_mode           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] spice.zlib_compression         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] upgrade_levels.baseapi         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] upgrade_levels.cert            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] upgrade_levels.compute         = auto {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] upgrade_levels.conductor       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] upgrade_levels.scheduler       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.cafile = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.certfile = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.insecure = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vendordata_dynamic_auth.timeout = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.api_retry_count         = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.ca_file                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.cache_prefix            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.cluster_name            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.connection_pool_size    = 10 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.console_delay_seconds   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.datastore_regex         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.host_ip                 = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.host_password           = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.host_port               = 443 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.host_username           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.insecure                = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.integration_bridge      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.maximum_objects         = 100 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.pbm_default_policy      = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.pbm_enabled             = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.pbm_wsdl_location       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.serial_port_proxy_uri   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.serial_port_service_uri = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.task_poll_interval      = 0.5 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.use_linked_clone        = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.vnc_keymap              = en-us {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.vnc_port                = 5900 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vmware.vnc_port_total          = 10000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.auth_schemes               = ['none'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.enabled                    = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.novncproxy_port            = 6080 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.vencrypt_ca_certs          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.vencrypt_client_cert       = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vnc.vencrypt_client_key        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.disable_rootwrap   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.enable_numa_live_migration = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.libvirt_disable_apic = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.client_socket_timeout     = 900 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.default_pool_size         = 1000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.keep_alive                = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.max_header_line           = 16384 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.ssl_ca_file               = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.ssl_cert_file             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.ssl_key_file              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.tcp_keepidle              = 600 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] zvm.ca_file                    = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] zvm.cloud_connector_url        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] zvm.reachable_timeout          = 300 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.enforce_new_defaults = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.enforce_scope      = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.policy_default_rule = default {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.connection_string     = messaging:// {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.enabled               = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.es_doc_type           = notification {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.es_scroll_size        = 10000 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.es_scroll_time        = 2m {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.filter_error_trace    = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.hmac_keys             = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.sentinel_service_name = mymaster {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.socket_timeout        = 0.1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.trace_requests        = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler.trace_sqlalchemy      = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler_jaeger.process_tags   = {} {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler_jaeger.service_name_prefix = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] profiler_otlp.service_name_prefix = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] remote_debug.host              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] remote_debug.port              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_notifications.retry = -1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.auth_section        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.auth_type           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.cafile              = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.certfile            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.collect_timing      = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.connect_retries     = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.connect_retry_delay = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.endpoint_id         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.endpoint_override   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.insecure            = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.keyfile             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.max_version         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.min_version         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.region_name         = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.service_name        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.service_type        = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.split_loggers       = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.status_code_retries = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.status_code_retry_delay = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.timeout             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.valid_interfaces    = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_limit.version             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_reports.file_event_handler = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] oslo_reports.log_dir           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_ovs_privileged.group  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] vif_plug_ovs_privileged.user   = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_ovs.isolate_vif         = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] os_brick.lock_path             = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] privsep_osbrick.capabilities   = [21] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] privsep_osbrick.group          = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] privsep_osbrick.helper_command = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] privsep_osbrick.user           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] nova_sys_admin.group           = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] nova_sys_admin.helper_command  = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] nova_sys_admin.user            = None {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG oslo_service.service [None req-405749af-2e49-4ec4-910c-323be3a40016 None None] ******************************************************************************** {{(pid=75026) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 10 19:11:57 user nova-compute[75026]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 10 19:11:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Connecting to libvirt: qemu:///system {{(pid=75026) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7feda0f4f010> {{(pid=75026) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 10 19:11:57 user nova-compute[75026]: libvirt:  error : internal error: could not initialize domain event timer
Nov 10 19:11:57 user nova-compute[75026]: WARNING nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 10 19:11:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7feda0f4f010> {{(pid=75026) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Starting native event thread {{(pid=75026) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Starting green dispatch thread {{(pid=75026) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 10 19:11:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Starting connection event dispatch thread {{(pid=75026) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 10 19:11:57 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Connection event '1' reason 'None'
Nov 10 19:11:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 19:11:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.mount [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Initialising _HostMountState generation 0 {{(pid=75026) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 10 19:12:04 user nova-compute[75026]: INFO nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host capabilities <capabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <host>
Nov 10 19:12:04 user nova-compute[75026]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 10 19:12:04 user nova-compute[75026]:     <cpu>
Nov 10 19:12:04 user nova-compute[75026]:       <arch>x86_64</arch>
Nov 10 19:12:04 user nova-compute[75026]:       <model>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <microcode version='1070'/>
Nov 10 19:12:04 user nova-compute[75026]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 10 19:12:04 user nova-compute[75026]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='osxsave'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='invtsc'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='rsba'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature name='skip-l1dfl-vmentry'/>
Nov 10 19:12:04 user nova-compute[75026]:       <pages unit='KiB' size='4'/>
Nov 10 19:12:04 user nova-compute[75026]:       <pages unit='KiB' size='2048'/>
Nov 10 19:12:04 user nova-compute[75026]:     </cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <power_management>
Nov 10 19:12:04 user nova-compute[75026]:       <suspend_mem/>
Nov 10 19:12:04 user nova-compute[75026]:       <suspend_disk/>
Nov 10 19:12:04 user nova-compute[75026]:       <suspend_hybrid/>
Nov 10 19:12:04 user nova-compute[75026]:     </power_management>
Nov 10 19:12:04 user nova-compute[75026]:     <iommu support='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <migration_features>
Nov 10 19:12:04 user nova-compute[75026]:       <live/>
Nov 10 19:12:04 user nova-compute[75026]:       <uri_transports>
Nov 10 19:12:04 user nova-compute[75026]:         <uri_transport>tcp</uri_transport>
Nov 10 19:12:04 user nova-compute[75026]:         <uri_transport>rdma</uri_transport>
Nov 10 19:12:04 user nova-compute[75026]:       </uri_transports>
Nov 10 19:12:04 user nova-compute[75026]:     </migration_features>
Nov 10 19:12:04 user nova-compute[75026]:     <topology>
Nov 10 19:12:04 user nova-compute[75026]:       <cells num='2'>
Nov 10 19:12:04 user nova-compute[75026]:         <cell id='0'>
Nov 10 19:12:04 user nova-compute[75026]:           <memory unit='KiB'>8189224</memory>
Nov 10 19:12:04 user nova-compute[75026]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 10 19:12:04 user nova-compute[75026]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 19:12:04 user nova-compute[75026]:           <distances>
Nov 10 19:12:04 user nova-compute[75026]:             <sibling id='0' value='10'/>
Nov 10 19:12:04 user nova-compute[75026]:             <sibling id='1' value='20'/>
Nov 10 19:12:04 user nova-compute[75026]:           </distances>
Nov 10 19:12:04 user nova-compute[75026]:           <cpus num='6'>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 10 19:12:04 user nova-compute[75026]:           </cpus>
Nov 10 19:12:04 user nova-compute[75026]:         </cell>
Nov 10 19:12:04 user nova-compute[75026]:         <cell id='1'>
Nov 10 19:12:04 user nova-compute[75026]:           <memory unit='KiB'>8206460</memory>
Nov 10 19:12:04 user nova-compute[75026]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 10 19:12:04 user nova-compute[75026]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 19:12:04 user nova-compute[75026]:           <distances>
Nov 10 19:12:04 user nova-compute[75026]:             <sibling id='0' value='20'/>
Nov 10 19:12:04 user nova-compute[75026]:             <sibling id='1' value='10'/>
Nov 10 19:12:04 user nova-compute[75026]:           </distances>
Nov 10 19:12:04 user nova-compute[75026]:           <cpus num='6'>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 10 19:12:04 user nova-compute[75026]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 10 19:12:04 user nova-compute[75026]:           </cpus>
Nov 10 19:12:04 user nova-compute[75026]:         </cell>
Nov 10 19:12:04 user nova-compute[75026]:       </cells>
Nov 10 19:12:04 user nova-compute[75026]:     </topology>
Nov 10 19:12:04 user nova-compute[75026]:     <cache>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 10 19:12:04 user nova-compute[75026]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 10 19:12:04 user nova-compute[75026]:     </cache>
Nov 10 19:12:04 user nova-compute[75026]:     <secmodel>
Nov 10 19:12:04 user nova-compute[75026]:       <model>apparmor</model>
Nov 10 19:12:04 user nova-compute[75026]:       <doi>0</doi>
Nov 10 19:12:04 user nova-compute[75026]:     </secmodel>
Nov 10 19:12:04 user nova-compute[75026]:     <secmodel>
Nov 10 19:12:04 user nova-compute[75026]:       <model>dac</model>
Nov 10 19:12:04 user nova-compute[75026]:       <doi>0</doi>
Nov 10 19:12:04 user nova-compute[75026]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 10 19:12:04 user nova-compute[75026]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 10 19:12:04 user nova-compute[75026]:     </secmodel>
Nov 10 19:12:04 user nova-compute[75026]:   </host>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='alpha'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>clipper</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='armv6l'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>spitz</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>nuri</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>kzm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sx1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>z2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>tosa</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>n810</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>n800</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>terrier</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>midway</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>microbit</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>verdex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>highbank</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>akita</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>connex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>collie</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='armv7l'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>spitz</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>nuri</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>kzm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sx1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>z2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>tosa</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>n810</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>n800</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>terrier</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>midway</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>microbit</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>verdex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>highbank</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>akita</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>connex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>collie</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='aarch64'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>spitz</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>nuri</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>kzm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sx1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>z2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>tosa</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>n810</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>n800</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>terrier</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>midway</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>microbit</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>verdex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>raspi3b</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>highbank</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>akita</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>connex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>collie</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <acpi default='on' toggle='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='cris'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='i686'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>isapc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>microvm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='kvm'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <pae/>
Nov 10 19:12:04 user nova-compute[75026]:       <nonpae/>
Nov 10 19:12:04 user nova-compute[75026]:       <acpi default='on' toggle='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:       <apic default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='m68k'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>an5206</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>q800</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>next-cube</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='microblaze'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='microblazeel'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='mips'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='16'>malta</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='mipsel'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='16'>malta</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='mips64'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='16'>malta</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>pica61</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>magnum</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='mips64el'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='16'>malta</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>pica61</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>magnum</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='16'>boston</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='ppc'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mac99</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>40p</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>taihu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='ppc64'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>taihu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>40p</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mac99</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='ppc64le'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>taihu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>40p</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>mac99</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='riscv32'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='8'>spike</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>opentitan</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='8'>virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='riscv64'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='8'>spike</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>shakti_c</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='8'>virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='s390x'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='sh4'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>shix</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>r2d</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='sh4eb'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>shix</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>r2d</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='sparc'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>SS-5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>SS-20</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>LX</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>SS-4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>SS-10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>Voyager</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='sparc64'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sun4u</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>niagara</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>sun4v</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='x86_64'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>64</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='1'>isapc</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>microvm</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='kvm'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <acpi default='on' toggle='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:       <apic default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='xtensa'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>sim</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>kc705</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>ml605</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>lx200</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>lx60</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]:   <guest>
Nov 10 19:12:04 user nova-compute[75026]:     <os_type>hvm</os_type>
Nov 10 19:12:04 user nova-compute[75026]:     <arch name='xtensaeb'>
Nov 10 19:12:04 user nova-compute[75026]:       <wordsize>32</wordsize>
Nov 10 19:12:04 user nova-compute[75026]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='4'>sim</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>kc705</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>ml605</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>virt</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>lx200</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>lx60</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 19:12:04 user nova-compute[75026]:       <domain type='qemu'/>
Nov 10 19:12:04 user nova-compute[75026]:     </arch>
Nov 10 19:12:04 user nova-compute[75026]:     <features>
Nov 10 19:12:04 user nova-compute[75026]:       <cpuselection/>
Nov 10 19:12:04 user nova-compute[75026]:       <deviceboot/>
Nov 10 19:12:04 user nova-compute[75026]:       <disksnapshot default='on' toggle='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     </features>
Nov 10 19:12:04 user nova-compute[75026]:   </guest>
Nov 10 19:12:04 user nova-compute[75026]: </capabilities>
Nov 10 19:12:04 user nova-compute[75026]: 
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 10 19:12:04 user nova-compute[75026]: <domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 19:12:04 user nova-compute[75026]:   <domain>kvm</domain>
Nov 10 19:12:04 user nova-compute[75026]:   <machine>pc-q35-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:   <arch>i686</arch>
Nov 10 19:12:04 user nova-compute[75026]:   <vcpu max='288'/>
Nov 10 19:12:04 user nova-compute[75026]:   <iothreads supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:   <os supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='firmware'/>
Nov 10 19:12:04 user nova-compute[75026]:     <loader supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>rom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pflash</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='readonly'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='secure'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </loader>
Nov 10 19:12:04 user nova-compute[75026]:   </os>
Nov 10 19:12:04 user nova-compute[75026]:   <cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-passthrough' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='hostPassthroughMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='maximum' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='maximumMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-model' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='umip'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibpb'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibrs'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='erms'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='lm'/>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='custom' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>qemu64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>qemu32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>phenom</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>n270</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>kvm64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>coreduo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>core2duo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>athlon</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Westmere</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Snowridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Penryn</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G5</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G4</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G1</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Rome</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Milan</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Dhyana</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cooperlake</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Conroe</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>486</model>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:   </cpu>
Nov 10 19:12:04 user nova-compute[75026]:   <memoryBacking supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='sourceType'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>file</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>anonymous</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>memfd</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:   </memoryBacking>
Nov 10 19:12:04 user nova-compute[75026]:   <devices>
Nov 10 19:12:04 user nova-compute[75026]:     <disk supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='diskDevice'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>disk</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cdrom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>floppy</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>lun</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='bus'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>fdc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sata</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </disk>
Nov 10 19:12:04 user nova-compute[75026]:     <graphics supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sdl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vnc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>spice</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egl-headless</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </graphics>
Nov 10 19:12:04 user nova-compute[75026]:     <video supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='modelType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cirrus</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vmvga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>qxl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>none</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>bochs</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ramfb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </video>
Nov 10 19:12:04 user nova-compute[75026]:     <hostdev supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='mode'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>subsystem</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='startupPolicy'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>default</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>mandatory</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>requisite</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>optional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='subsysType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pci</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='capsType'/>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='pciBackend'/>
Nov 10 19:12:04 user nova-compute[75026]:     </hostdev>
Nov 10 19:12:04 user nova-compute[75026]:     <rng supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>random</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egd</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>builtin</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </rng>
Nov 10 19:12:04 user nova-compute[75026]:     <filesystem supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='driverType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>path</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>handle</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtiofs</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </filesystem>
Nov 10 19:12:04 user nova-compute[75026]:     <tpm supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-tis</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-crb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>passthrough</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>emulator</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </tpm>
Nov 10 19:12:04 user nova-compute[75026]:   </devices>
Nov 10 19:12:04 user nova-compute[75026]:   <features>
Nov 10 19:12:04 user nova-compute[75026]:     <gic supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <vmcoreinfo supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <genid supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backingStoreInput supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backup supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <sev supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:   </features>
Nov 10 19:12:04 user nova-compute[75026]: </domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 10 19:12:04 user nova-compute[75026]: <domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 19:12:04 user nova-compute[75026]:   <domain>kvm</domain>
Nov 10 19:12:04 user nova-compute[75026]:   <machine>pc-i440fx-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:   <arch>i686</arch>
Nov 10 19:12:04 user nova-compute[75026]:   <vcpu max='255'/>
Nov 10 19:12:04 user nova-compute[75026]:   <iothreads supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:   <os supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='firmware'/>
Nov 10 19:12:04 user nova-compute[75026]:     <loader supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>rom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pflash</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='readonly'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='secure'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </loader>
Nov 10 19:12:04 user nova-compute[75026]:   </os>
Nov 10 19:12:04 user nova-compute[75026]:   <cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-passthrough' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='hostPassthroughMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='maximum' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='maximumMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-model' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='umip'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibpb'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibrs'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='erms'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='lm'/>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='custom' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>qemu64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>qemu32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>phenom</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>n270</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>kvm64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>coreduo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>core2duo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>athlon</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Westmere</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Snowridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Penryn</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G5</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G4</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G1</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Rome</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Milan</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Dhyana</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cooperlake</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Conroe</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>486</model>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:   </cpu>
Nov 10 19:12:04 user nova-compute[75026]:   <memoryBacking supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='sourceType'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>file</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>anonymous</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>memfd</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:   </memoryBacking>
Nov 10 19:12:04 user nova-compute[75026]:   <devices>
Nov 10 19:12:04 user nova-compute[75026]:     <disk supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='diskDevice'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>disk</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cdrom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>floppy</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>lun</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='bus'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ide</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>fdc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sata</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </disk>
Nov 10 19:12:04 user nova-compute[75026]:     <graphics supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sdl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vnc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>spice</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egl-headless</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </graphics>
Nov 10 19:12:04 user nova-compute[75026]:     <video supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='modelType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cirrus</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vmvga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>qxl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>none</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>bochs</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ramfb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </video>
Nov 10 19:12:04 user nova-compute[75026]:     <hostdev supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='mode'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>subsystem</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='startupPolicy'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>default</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>mandatory</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>requisite</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>optional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='subsysType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pci</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='capsType'/>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='pciBackend'/>
Nov 10 19:12:04 user nova-compute[75026]:     </hostdev>
Nov 10 19:12:04 user nova-compute[75026]:     <rng supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>random</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egd</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>builtin</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </rng>
Nov 10 19:12:04 user nova-compute[75026]:     <filesystem supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='driverType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>path</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>handle</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtiofs</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </filesystem>
Nov 10 19:12:04 user nova-compute[75026]:     <tpm supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-tis</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-crb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>passthrough</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>emulator</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </tpm>
Nov 10 19:12:04 user nova-compute[75026]:   </devices>
Nov 10 19:12:04 user nova-compute[75026]:   <features>
Nov 10 19:12:04 user nova-compute[75026]:     <gic supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <vmcoreinfo supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <genid supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backingStoreInput supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backup supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <sev supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:   </features>
Nov 10 19:12:04 user nova-compute[75026]: </domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 10 19:12:04 user nova-compute[75026]: <domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 19:12:04 user nova-compute[75026]:   <domain>kvm</domain>
Nov 10 19:12:04 user nova-compute[75026]:   <machine>pc-q35-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:   <arch>i686</arch>
Nov 10 19:12:04 user nova-compute[75026]:   <vcpu max='288'/>
Nov 10 19:12:04 user nova-compute[75026]:   <iothreads supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:   <os supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='firmware'/>
Nov 10 19:12:04 user nova-compute[75026]:     <loader supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>rom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pflash</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='readonly'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='secure'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </loader>
Nov 10 19:12:04 user nova-compute[75026]:   </os>
Nov 10 19:12:04 user nova-compute[75026]:   <cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-passthrough' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='hostPassthroughMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='maximum' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='maximumMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-model' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='umip'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibpb'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibrs'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='erms'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='lm'/>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='custom' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>qemu64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>qemu32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>phenom</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>n270</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>kvm64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>coreduo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>core2duo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>athlon</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Westmere</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Snowridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Penryn</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G5</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G4</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G1</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Rome</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Milan</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Dhyana</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cooperlake</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Conroe</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>486</model>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:   </cpu>
Nov 10 19:12:04 user nova-compute[75026]:   <memoryBacking supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='sourceType'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>file</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>anonymous</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>memfd</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:   </memoryBacking>
Nov 10 19:12:04 user nova-compute[75026]:   <devices>
Nov 10 19:12:04 user nova-compute[75026]:     <disk supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='diskDevice'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>disk</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cdrom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>floppy</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>lun</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='bus'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>fdc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sata</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </disk>
Nov 10 19:12:04 user nova-compute[75026]:     <graphics supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sdl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vnc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>spice</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egl-headless</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </graphics>
Nov 10 19:12:04 user nova-compute[75026]:     <video supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='modelType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cirrus</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vmvga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>qxl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>none</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>bochs</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ramfb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </video>
Nov 10 19:12:04 user nova-compute[75026]:     <hostdev supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='mode'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>subsystem</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='startupPolicy'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>default</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>mandatory</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>requisite</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>optional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='subsysType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pci</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='capsType'/>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='pciBackend'/>
Nov 10 19:12:04 user nova-compute[75026]:     </hostdev>
Nov 10 19:12:04 user nova-compute[75026]:     <rng supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>random</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egd</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>builtin</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </rng>
Nov 10 19:12:04 user nova-compute[75026]:     <filesystem supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='driverType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>path</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>handle</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtiofs</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </filesystem>
Nov 10 19:12:04 user nova-compute[75026]:     <tpm supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-tis</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-crb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>passthrough</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>emulator</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </tpm>
Nov 10 19:12:04 user nova-compute[75026]:   </devices>
Nov 10 19:12:04 user nova-compute[75026]:   <features>
Nov 10 19:12:04 user nova-compute[75026]:     <gic supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <vmcoreinfo supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <genid supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backingStoreInput supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backup supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <sev supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:   </features>
Nov 10 19:12:04 user nova-compute[75026]: </domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 10 19:12:04 user nova-compute[75026]: <domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 19:12:04 user nova-compute[75026]:   <domain>kvm</domain>
Nov 10 19:12:04 user nova-compute[75026]:   <machine>pc-i440fx-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:   <arch>i686</arch>
Nov 10 19:12:04 user nova-compute[75026]:   <vcpu max='255'/>
Nov 10 19:12:04 user nova-compute[75026]:   <iothreads supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:   <os supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='firmware'/>
Nov 10 19:12:04 user nova-compute[75026]:     <loader supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>rom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pflash</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='readonly'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='secure'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </loader>
Nov 10 19:12:04 user nova-compute[75026]:   </os>
Nov 10 19:12:04 user nova-compute[75026]:   <cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-passthrough' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='hostPassthroughMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='maximum' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='maximumMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-model' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='umip'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibpb'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibrs'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='erms'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='lm'/>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='custom' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>qemu64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>qemu32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>phenom</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>n270</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>kvm64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>coreduo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>core2duo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>athlon</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Westmere</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Snowridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Penryn</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G5</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G4</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G1</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Rome</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Milan</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Dhyana</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cooperlake</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Conroe</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>486</model>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:   </cpu>
Nov 10 19:12:04 user nova-compute[75026]:   <memoryBacking supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='sourceType'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>file</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>anonymous</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>memfd</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:   </memoryBacking>
Nov 10 19:12:04 user nova-compute[75026]:   <devices>
Nov 10 19:12:04 user nova-compute[75026]:     <disk supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='diskDevice'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>disk</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cdrom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>floppy</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>lun</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='bus'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ide</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>fdc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sata</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </disk>
Nov 10 19:12:04 user nova-compute[75026]:     <graphics supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sdl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vnc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>spice</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egl-headless</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </graphics>
Nov 10 19:12:04 user nova-compute[75026]:     <video supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='modelType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cirrus</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vmvga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>qxl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>none</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>bochs</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ramfb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </video>
Nov 10 19:12:04 user nova-compute[75026]:     <hostdev supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='mode'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>subsystem</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='startupPolicy'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>default</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>mandatory</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>requisite</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>optional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='subsysType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pci</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='capsType'/>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='pciBackend'/>
Nov 10 19:12:04 user nova-compute[75026]:     </hostdev>
Nov 10 19:12:04 user nova-compute[75026]:     <rng supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>random</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egd</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>builtin</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </rng>
Nov 10 19:12:04 user nova-compute[75026]:     <filesystem supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='driverType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>path</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>handle</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtiofs</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </filesystem>
Nov 10 19:12:04 user nova-compute[75026]:     <tpm supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-tis</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-crb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>passthrough</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>emulator</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </tpm>
Nov 10 19:12:04 user nova-compute[75026]:   </devices>
Nov 10 19:12:04 user nova-compute[75026]:   <features>
Nov 10 19:12:04 user nova-compute[75026]:     <gic supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <vmcoreinfo supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <genid supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backingStoreInput supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backup supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <sev supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:   </features>
Nov 10 19:12:04 user nova-compute[75026]: </domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 10 19:12:04 user nova-compute[75026]: <domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 19:12:04 user nova-compute[75026]:   <domain>kvm</domain>
Nov 10 19:12:04 user nova-compute[75026]:   <machine>pc-q35-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:   <arch>x86_64</arch>
Nov 10 19:12:04 user nova-compute[75026]:   <vcpu max='288'/>
Nov 10 19:12:04 user nova-compute[75026]:   <iothreads supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:   <os supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='firmware'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>efi</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:     <loader supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>rom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pflash</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='readonly'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='secure'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </loader>
Nov 10 19:12:04 user nova-compute[75026]:   </os>
Nov 10 19:12:04 user nova-compute[75026]:   <cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-passthrough' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='hostPassthroughMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='maximum' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='maximumMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-model' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='umip'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='invtsc'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibpb'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibrs'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='rsba'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='erms'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='custom' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>qemu64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>qemu32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>phenom</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>n270</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>coreduo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>core2duo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>athlon</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Westmere</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Snowridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Penryn</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G5</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G4</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Opteron_G1</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Rome</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Milan</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Dhyana</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cooperlake</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Conroe</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>486</model>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:   </cpu>
Nov 10 19:12:04 user nova-compute[75026]:   <memoryBacking supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='sourceType'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>file</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>anonymous</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>memfd</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:   </memoryBacking>
Nov 10 19:12:04 user nova-compute[75026]:   <devices>
Nov 10 19:12:04 user nova-compute[75026]:     <disk supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='diskDevice'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>disk</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cdrom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>floppy</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>lun</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='bus'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>fdc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sata</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </disk>
Nov 10 19:12:04 user nova-compute[75026]:     <graphics supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sdl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vnc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>spice</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egl-headless</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </graphics>
Nov 10 19:12:04 user nova-compute[75026]:     <video supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='modelType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cirrus</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vmvga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>qxl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>none</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>bochs</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ramfb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </video>
Nov 10 19:12:04 user nova-compute[75026]:     <hostdev supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='mode'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>subsystem</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='startupPolicy'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>default</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>mandatory</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>requisite</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>optional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='subsysType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pci</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='capsType'/>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='pciBackend'/>
Nov 10 19:12:04 user nova-compute[75026]:     </hostdev>
Nov 10 19:12:04 user nova-compute[75026]:     <rng supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>random</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egd</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>builtin</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </rng>
Nov 10 19:12:04 user nova-compute[75026]:     <filesystem supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='driverType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>path</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>handle</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtiofs</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </filesystem>
Nov 10 19:12:04 user nova-compute[75026]:     <tpm supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-tis</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-crb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>passthrough</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>emulator</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </tpm>
Nov 10 19:12:04 user nova-compute[75026]:   </devices>
Nov 10 19:12:04 user nova-compute[75026]:   <features>
Nov 10 19:12:04 user nova-compute[75026]:     <gic supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <vmcoreinfo supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <genid supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backingStoreInput supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backup supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <sev supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:   </features>
Nov 10 19:12:04 user nova-compute[75026]: </domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 10 19:12:04 user nova-compute[75026]: <domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 19:12:04 user nova-compute[75026]:   <domain>kvm</domain>
Nov 10 19:12:04 user nova-compute[75026]:   <machine>pc-i440fx-6.2</machine>
Nov 10 19:12:04 user nova-compute[75026]:   <arch>x86_64</arch>
Nov 10 19:12:04 user nova-compute[75026]:   <vcpu max='255'/>
Nov 10 19:12:04 user nova-compute[75026]:   <iothreads supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:   <os supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='firmware'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>efi</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:     <loader supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>rom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pflash</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='readonly'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='secure'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </loader>
Nov 10 19:12:04 user nova-compute[75026]:   </os>
Nov 10 19:12:04 user nova-compute[75026]:   <cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-passthrough' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='hostPassthroughMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='maximum' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='maximumMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-model' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='umip'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='invtsc'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibpb'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibrs'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='rsba'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='erms'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='custom' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>qemu64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>qemu32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>phenom</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>n270</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>coreduo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>core2duo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>athlon</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Westmere</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Snowridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Penryn</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G5</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G4</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Opteron_G1</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Rome</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Milan</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Dhyana</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cooperlake</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Conroe</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>486</model>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:   </cpu>
Nov 10 19:12:04 user nova-compute[75026]:   <memoryBacking supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='sourceType'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>file</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>anonymous</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>memfd</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:   </memoryBacking>
Nov 10 19:12:04 user nova-compute[75026]:   <devices>
Nov 10 19:12:04 user nova-compute[75026]:     <disk supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='diskDevice'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>disk</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cdrom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>floppy</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>lun</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='bus'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ide</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>fdc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sata</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </disk>
Nov 10 19:12:04 user nova-compute[75026]:     <graphics supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sdl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vnc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>spice</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egl-headless</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </graphics>
Nov 10 19:12:04 user nova-compute[75026]:     <video supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='modelType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cirrus</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vmvga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>qxl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>none</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>bochs</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ramfb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </video>
Nov 10 19:12:04 user nova-compute[75026]:     <hostdev supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='mode'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>subsystem</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='startupPolicy'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>default</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>mandatory</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>requisite</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>optional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='subsysType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pci</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='capsType'/>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='pciBackend'/>
Nov 10 19:12:04 user nova-compute[75026]:     </hostdev>
Nov 10 19:12:04 user nova-compute[75026]:     <rng supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>random</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egd</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>builtin</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </rng>
Nov 10 19:12:04 user nova-compute[75026]:     <filesystem supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='driverType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>path</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>handle</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtiofs</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </filesystem>
Nov 10 19:12:04 user nova-compute[75026]:     <tpm supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-tis</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-crb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>passthrough</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>emulator</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </tpm>
Nov 10 19:12:04 user nova-compute[75026]:   </devices>
Nov 10 19:12:04 user nova-compute[75026]:   <features>
Nov 10 19:12:04 user nova-compute[75026]:     <gic supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <vmcoreinfo supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <genid supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backingStoreInput supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backup supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <sev supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:   </features>
Nov 10 19:12:04 user nova-compute[75026]: </domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 10 19:12:04 user nova-compute[75026]: <domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 19:12:04 user nova-compute[75026]:   <domain>kvm</domain>
Nov 10 19:12:04 user nova-compute[75026]:   <machine>pc-q35-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:   <arch>x86_64</arch>
Nov 10 19:12:04 user nova-compute[75026]:   <vcpu max='288'/>
Nov 10 19:12:04 user nova-compute[75026]:   <iothreads supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:   <os supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='firmware'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>efi</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:     <loader supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>rom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pflash</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='readonly'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='secure'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </loader>
Nov 10 19:12:04 user nova-compute[75026]:   </os>
Nov 10 19:12:04 user nova-compute[75026]:   <cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-passthrough' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='hostPassthroughMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='maximum' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='maximumMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-model' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='umip'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='invtsc'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibpb'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibrs'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='rsba'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='erms'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='custom' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>qemu64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>qemu32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>phenom</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>n270</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>coreduo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>core2duo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>athlon</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Westmere</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Snowridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Penryn</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G5</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G4</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Opteron_G1</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Rome</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Milan</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Dhyana</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cooperlake</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Conroe</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>486</model>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:   </cpu>
Nov 10 19:12:04 user nova-compute[75026]:   <memoryBacking supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='sourceType'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>file</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>anonymous</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>memfd</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:   </memoryBacking>
Nov 10 19:12:04 user nova-compute[75026]:   <devices>
Nov 10 19:12:04 user nova-compute[75026]:     <disk supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='diskDevice'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>disk</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cdrom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>floppy</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>lun</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='bus'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>fdc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sata</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </disk>
Nov 10 19:12:04 user nova-compute[75026]:     <graphics supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sdl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vnc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>spice</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egl-headless</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </graphics>
Nov 10 19:12:04 user nova-compute[75026]:     <video supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='modelType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cirrus</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vmvga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>qxl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>none</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>bochs</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ramfb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </video>
Nov 10 19:12:04 user nova-compute[75026]:     <hostdev supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='mode'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>subsystem</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='startupPolicy'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>default</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>mandatory</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>requisite</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>optional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='subsysType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pci</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='capsType'/>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='pciBackend'/>
Nov 10 19:12:04 user nova-compute[75026]:     </hostdev>
Nov 10 19:12:04 user nova-compute[75026]:     <rng supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>random</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egd</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>builtin</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </rng>
Nov 10 19:12:04 user nova-compute[75026]:     <filesystem supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='driverType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>path</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>handle</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtiofs</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </filesystem>
Nov 10 19:12:04 user nova-compute[75026]:     <tpm supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-tis</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-crb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>passthrough</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>emulator</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </tpm>
Nov 10 19:12:04 user nova-compute[75026]:   </devices>
Nov 10 19:12:04 user nova-compute[75026]:   <features>
Nov 10 19:12:04 user nova-compute[75026]:     <gic supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <vmcoreinfo supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <genid supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backingStoreInput supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backup supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <sev supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:   </features>
Nov 10 19:12:04 user nova-compute[75026]: </domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 10 19:12:04 user nova-compute[75026]: <domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 19:12:04 user nova-compute[75026]:   <domain>kvm</domain>
Nov 10 19:12:04 user nova-compute[75026]:   <machine>pc-i440fx-jammy</machine>
Nov 10 19:12:04 user nova-compute[75026]:   <arch>x86_64</arch>
Nov 10 19:12:04 user nova-compute[75026]:   <vcpu max='255'/>
Nov 10 19:12:04 user nova-compute[75026]:   <iothreads supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:   <os supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='firmware'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>efi</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:     <loader supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>rom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pflash</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='readonly'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>yes</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='secure'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>no</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </loader>
Nov 10 19:12:04 user nova-compute[75026]:   </os>
Nov 10 19:12:04 user nova-compute[75026]:   <cpu>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-passthrough' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='hostPassthroughMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='maximum' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='maximumMigratable'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>on</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>off</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='host-model' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <vendor>Intel</vendor>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ss'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='vmx'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pcid'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='hypervisor'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arat'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='umip'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='md-clear'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='invtsc'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibpb'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='ibrs'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-stibp'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='rsba'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='erms'/>
Nov 10 19:12:04 user nova-compute[75026]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:     <mode name='custom' supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>qemu64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>qemu32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>phenom</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>pentium</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>n270</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm64</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>kvm32</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>coreduo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>core2duo</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>athlon</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Westmere</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Snowridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Skylake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>SandyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Penryn</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G5</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G4</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G3</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Opteron_G2</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Opteron_G1</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>IvyBridge</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Icelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Haswell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Rome</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-Milan</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>EPYC</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Dhyana</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cooperlake</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>Conroe</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='no'>Broadwell</model>
Nov 10 19:12:04 user nova-compute[75026]:       <model usable='yes'>486</model>
Nov 10 19:12:04 user nova-compute[75026]:     </mode>
Nov 10 19:12:04 user nova-compute[75026]:   </cpu>
Nov 10 19:12:04 user nova-compute[75026]:   <memoryBacking supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:     <enum name='sourceType'>
Nov 10 19:12:04 user nova-compute[75026]:       <value>file</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>anonymous</value>
Nov 10 19:12:04 user nova-compute[75026]:       <value>memfd</value>
Nov 10 19:12:04 user nova-compute[75026]:     </enum>
Nov 10 19:12:04 user nova-compute[75026]:   </memoryBacking>
Nov 10 19:12:04 user nova-compute[75026]:   <devices>
Nov 10 19:12:04 user nova-compute[75026]:     <disk supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='diskDevice'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>disk</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cdrom</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>floppy</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>lun</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='bus'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ide</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>fdc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sata</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </disk>
Nov 10 19:12:04 user nova-compute[75026]:     <graphics supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='type'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>sdl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vnc</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>spice</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egl-headless</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </graphics>
Nov 10 19:12:04 user nova-compute[75026]:     <video supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='modelType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>cirrus</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>vmvga</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>qxl</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>none</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>bochs</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>ramfb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </video>
Nov 10 19:12:04 user nova-compute[75026]:     <hostdev supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='mode'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>subsystem</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='startupPolicy'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>default</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>mandatory</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>requisite</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>optional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='subsysType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>usb</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>pci</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>scsi</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='capsType'/>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='pciBackend'/>
Nov 10 19:12:04 user nova-compute[75026]:     </hostdev>
Nov 10 19:12:04 user nova-compute[75026]:     <rng supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtio-non-transitional</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>random</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>egd</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>builtin</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </rng>
Nov 10 19:12:04 user nova-compute[75026]:     <filesystem supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='driverType'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>path</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>handle</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>virtiofs</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </filesystem>
Nov 10 19:12:04 user nova-compute[75026]:     <tpm supported='yes'>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='model'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-tis</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>tpm-crb</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:       <enum name='backendModel'>
Nov 10 19:12:04 user nova-compute[75026]:         <value>passthrough</value>
Nov 10 19:12:04 user nova-compute[75026]:         <value>emulator</value>
Nov 10 19:12:04 user nova-compute[75026]:       </enum>
Nov 10 19:12:04 user nova-compute[75026]:     </tpm>
Nov 10 19:12:04 user nova-compute[75026]:   </devices>
Nov 10 19:12:04 user nova-compute[75026]:   <features>
Nov 10 19:12:04 user nova-compute[75026]:     <gic supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:     <vmcoreinfo supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <genid supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backingStoreInput supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <backup supported='yes'/>
Nov 10 19:12:04 user nova-compute[75026]:     <sev supported='no'/>
Nov 10 19:12:04 user nova-compute[75026]:   </features>
Nov 10 19:12:04 user nova-compute[75026]: </domainCapabilities>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Checking secure boot support for host arch (x86_64) {{(pid=75026) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 19:12:04 user nova-compute[75026]: INFO nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Secure Boot support detected
Nov 10 19:12:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] cpu compare xml: <cpu match="exact">
Nov 10 19:12:04 user nova-compute[75026]:   <model>Nehalem</model>
Nov 10 19:12:04 user nova-compute[75026]: </cpu>
Nov 10 19:12:04 user nova-compute[75026]:  {{(pid=75026) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 10 19:12:05 user nova-compute[75026]: INFO nova.virt.node [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Generated node identity 0f7a5134-86ad-47cc-91e0-39a40ebb3a90
Nov 10 19:12:05 user nova-compute[75026]: INFO nova.virt.node [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Wrote node identity 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 to /opt/stack/data/nova/compute_id
Nov 10 19:12:05 user nova-compute[75026]: WARNING nova.compute.manager [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Compute nodes ['0f7a5134-86ad-47cc-91e0-39a40ebb3a90'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 10 19:12:05 user nova-compute[75026]: INFO nova.compute.manager [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 10 19:12:05 user nova-compute[75026]: WARNING nova.compute.manager [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 19:12:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:12:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:12:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:12:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:12:05 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:12:05 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:12:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Hypervisor/Node resource view: name=user free_ram=10946MB free_disk=26.28966522216797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:12:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:12:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:12:05 user nova-compute[75026]: WARNING nova.compute.resource_tracker [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] No compute node record for user:0f7a5134-86ad-47cc-91e0-39a40ebb3a90: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 could not be found.
Nov 10 19:12:05 user nova-compute[75026]: INFO nova.compute.resource_tracker [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Compute node record created for user:user with uuid: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90
Nov 10 19:12:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:12:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:12:05 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] [req-7d114938-96be-4e62-8caa-333f8c7e63aa] Created resource provider record via placement API for resource provider with UUID 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 and name user.
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75026) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 10 19:12:06 user nova-compute[75026]: INFO nova.virt.libvirt.host [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] kernel doesn't support AMD SEV
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Libvirt baseline CPU <cpu>
Nov 10 19:12:06 user nova-compute[75026]:   <arch>x86_64</arch>
Nov 10 19:12:06 user nova-compute[75026]:   <model>Nehalem</model>
Nov 10 19:12:06 user nova-compute[75026]:   <vendor>Intel</vendor>
Nov 10 19:12:06 user nova-compute[75026]:   <topology sockets="6" cores="1" threads="1"/>
Nov 10 19:12:06 user nova-compute[75026]: </cpu>
Nov 10 19:12:06 user nova-compute[75026]:  {{(pid=75026) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Updated inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Updating resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 generation from 0 to 1 during operation: update_inventory {{(pid=75026) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Updating resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 generation from 1 to 2 during operation: update_traits {{(pid=75026) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.769s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.service [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Creating RPC server for service compute {{(pid=75026) start /opt/stack/nova/nova/service.py:182}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.service [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] Join ServiceGroup membership for this service compute {{(pid=75026) start /opt/stack/nova/nova/service.py:199}}
Nov 10 19:12:06 user nova-compute[75026]: DEBUG nova.servicegroup.drivers.db [None req-45b0ea99-dbfe-4ac7-afca-fa259aba14da None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75026) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 10 19:12:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:12:56 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:12:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:12:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:12:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=10384MB free_disk=26.19353485107422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:12:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:12:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:12:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:12:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:12:57 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:12:57 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:12:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:12:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:13:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:13:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:13:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=26.257671356201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:13:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:13:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:13:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:13:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:13:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:13:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:14:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:14:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:14:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:14:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:14:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:14:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:14:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:14:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:14:58 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:14:58 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:14:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=10352MB free_disk=26.010295867919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:14:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:14:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:14:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:14:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:14:58 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:14:58 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:14:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:14:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:14:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:14:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:14:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:14:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:14:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:14:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:14:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:15:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:15:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:15:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:15:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:15:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:15:59 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:15:59 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:15:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9586MB free_disk=26.037548065185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:15:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:15:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:15:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:15:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:15:59 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:15:59 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:15:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:15:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:16:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:16:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:16:06 user nova-compute[75026]: INFO nova.compute.claims [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Claim successful on node user
Nov 10 19:16:06 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:16:06 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:16:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:16:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:16:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Creating image(s)
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "/opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "/opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "/opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.005s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG nova.policy [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f56fae1310544d9a8afb8f557d52b621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0165786339c0416ab29163bea0f79c81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd.part --force-share --output=json" returned: 0 in 0.265s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG nova.virt.images [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] da817026-309f-4431-a8d4-b6d8e64853b2 was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd.part /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:16:08 user nova-compute[75026]: INFO nova.compute.claims [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Claim successful on node user
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd.part /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd.converted" returned: 0 in 0.440s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.304s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:08 user nova-compute[75026]: INFO oslo.privsep.daemon [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9r7yas3_/privsep.sock']
Nov 10 19:16:08 user sudo[84303]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9r7yas3_/privsep.sock
Nov 10 19:16:08 user sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 19:16:08 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "31abf353-32fa-4b39-a2b3-02b63976b997" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "31abf353-32fa-4b39-a2b3-02b63976b997" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:16:09 user nova-compute[75026]: INFO nova.compute.claims [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Claim successful on node user
Nov 10 19:16:09 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:16:09 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Creating image(s)
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.policy [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3955d2948c446c8b555fb7fea429581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49d22011dbaa43728771bc3d1eefaa30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:16:09 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Successfully created port: 20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.policy [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8448d842ea1f478392fbdb0c27afed56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16cff5b9b94e95b61b63e8ffd25066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:16:09 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Creating image(s)
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "/opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "/opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "/opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:10 user sudo[84303]: pam_unix(sudo:session): session closed for user root
Nov 10 19:16:10 user nova-compute[75026]: INFO oslo.privsep.daemon [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Spawned new privsep daemon via rootwrap
Nov 10 19:16:10 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 19:16:10 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 19:16:10 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 10 19:16:10 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84314
Nov 10 19:16:10 user nova-compute[75026]: WARNING oslo_privsep.priv_context [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] privsep daemon already running
Nov 10 19:16:10 user nova-compute[75026]: WARNING oslo_privsep.priv_context [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] privsep daemon already running
Nov 10 19:16:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.231s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.234s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.228s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk 1073741824" returned: 0 in 0.058s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.209s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.213s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.231s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk 1073741824" returned: 0 in 0.049s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.496s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Cannot resize image /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Ensure instance console log exists: /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.220s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.240s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk 1073741824" returned: 0 in 0.050s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Cannot resize image /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Ensure instance console log exists: /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Successfully created port: acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Successfully created port: 2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Cannot resize image /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Ensure instance console log exists: /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Successfully updated port: 20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:16:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquired lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:16:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:16:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-44fe8541-a34f-4126-83a5-53758f82e1ee req-36f90bd2-75b1-4e59-9212-2f6461867df0 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received event network-changed-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-44fe8541-a34f-4126-83a5-53758f82e1ee req-36f90bd2-75b1-4e59-9212-2f6461867df0 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Refreshing instance network info cache due to event network-changed-20276b2d-b468-4438-8434-648d3ca04e9c. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:16:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-44fe8541-a34f-4126-83a5-53758f82e1ee req-36f90bd2-75b1-4e59-9212-2f6461867df0 service nova] Acquiring lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Updating instance_info_cache with network_info: [{"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Releasing lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Instance network_info: |[{"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-44fe8541-a34f-4126-83a5-53758f82e1ee req-36f90bd2-75b1-4e59-9212-2f6461867df0 service nova] Acquired lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-44fe8541-a34f-4126-83a5-53758f82e1ee req-36f90bd2-75b1-4e59-9212-2f6461867df0 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Refreshing network info cache for port 20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Start _get_guest_xml network_info=[{"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:16:14 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:14 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-781441838',display_name='tempest-DeleteServersTestJSON-server-781441838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-781441838',id=1,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0165786339c0416ab29163bea0f79c81',ramdisk_id='',reservation_id='r-ncng8l0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1223626386',owner_user_name='tempest-DeleteServersTestJSON-1223626386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:07Z,user_data=None,user_id='f56fae1310544d9a8afb8f557d52b621',uuid=691738e9-227f-4f34-a56e-039c3380f179,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Converting VIF {"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:33:86,bridge_name='br-int',has_traffic_filtering=True,id=20276b2d-b468-4438-8434-648d3ca04e9c,network=Network(b7e221fd-bce7-4761-a4ef-7435e306d966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20276b2d-b4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lazy-loading 'pci_devices' on Instance uuid 691738e9-227f-4f34-a56e-039c3380f179 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:16:14 user nova-compute[75026]:   <uuid>691738e9-227f-4f34-a56e-039c3380f179</uuid>
Nov 10 19:16:14 user nova-compute[75026]:   <name>instance-00000001</name>
Nov 10 19:16:14 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:16:14 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:16:14 user nova-compute[75026]:   <metadata>
Nov 10 19:16:14 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:16:14 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:16:14 user nova-compute[75026]:       <nova:name>tempest-DeleteServersTestJSON-server-781441838</nova:name>
Nov 10 19:16:14 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:16:14</nova:creationTime>
Nov 10 19:16:14 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:16:14 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:16:14 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:16:14 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:16:14 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:16:14 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:16:14 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:16:14 user nova-compute[75026]:       <nova:owner>
Nov 10 19:16:14 user nova-compute[75026]:         <nova:user uuid="f56fae1310544d9a8afb8f557d52b621">tempest-DeleteServersTestJSON-1223626386-project-member</nova:user>
Nov 10 19:16:14 user nova-compute[75026]:         <nova:project uuid="0165786339c0416ab29163bea0f79c81">tempest-DeleteServersTestJSON-1223626386</nova:project>
Nov 10 19:16:14 user nova-compute[75026]:       </nova:owner>
Nov 10 19:16:14 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:16:14 user nova-compute[75026]:       <nova:ports>
Nov 10 19:16:14 user nova-compute[75026]:         <nova:port uuid="20276b2d-b468-4438-8434-648d3ca04e9c">
Nov 10 19:16:14 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:16:14 user nova-compute[75026]:         </nova:port>
Nov 10 19:16:14 user nova-compute[75026]:       </nova:ports>
Nov 10 19:16:14 user nova-compute[75026]:     </nova:instance>
Nov 10 19:16:14 user nova-compute[75026]:   </metadata>
Nov 10 19:16:14 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:16:14 user nova-compute[75026]:     <system>
Nov 10 19:16:14 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:16:14 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:16:14 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:16:14 user nova-compute[75026]:       <entry name="serial">691738e9-227f-4f34-a56e-039c3380f179</entry>
Nov 10 19:16:14 user nova-compute[75026]:       <entry name="uuid">691738e9-227f-4f34-a56e-039c3380f179</entry>
Nov 10 19:16:14 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:16:14 user nova-compute[75026]:     </system>
Nov 10 19:16:14 user nova-compute[75026]:   </sysinfo>
Nov 10 19:16:14 user nova-compute[75026]:   <os>
Nov 10 19:16:14 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:16:14 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:16:14 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:16:14 user nova-compute[75026]:   </os>
Nov 10 19:16:14 user nova-compute[75026]:   <features>
Nov 10 19:16:14 user nova-compute[75026]:     <acpi/>
Nov 10 19:16:14 user nova-compute[75026]:     <apic/>
Nov 10 19:16:14 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:16:14 user nova-compute[75026]:   </features>
Nov 10 19:16:14 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:16:14 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:16:14 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:16:14 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:16:14 user nova-compute[75026]:   </clock>
Nov 10 19:16:14 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:16:14 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:16:14 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:16:14 user nova-compute[75026]:   </cpu>
Nov 10 19:16:14 user nova-compute[75026]:   <devices>
Nov 10 19:16:14 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:16:14 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:16:14 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk"/>
Nov 10 19:16:14 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:16:14 user nova-compute[75026]:     </disk>
Nov 10 19:16:14 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:16:14 user nova-compute[75026]:       <mac address="fa:16:3e:8c:33:86"/>
Nov 10 19:16:14 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:14 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:16:14 user nova-compute[75026]:       <target dev="tap20276b2d-b4"/>
Nov 10 19:16:14 user nova-compute[75026]:     </interface>
Nov 10 19:16:14 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:16:14 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/console.log" append="off"/>
Nov 10 19:16:14 user nova-compute[75026]:     </serial>
Nov 10 19:16:14 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:16:14 user nova-compute[75026]:     <video>
Nov 10 19:16:14 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:14 user nova-compute[75026]:     </video>
Nov 10 19:16:14 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:16:14 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:16:14 user nova-compute[75026]:     </rng>
Nov 10 19:16:14 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:16:14 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:16:14 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:16:14 user nova-compute[75026]:     </memballoon>
Nov 10 19:16:14 user nova-compute[75026]:   </devices>
Nov 10 19:16:14 user nova-compute[75026]: </domain>
Nov 10 19:16:14 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-781441838',display_name='tempest-DeleteServersTestJSON-server-781441838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-781441838',id=1,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0165786339c0416ab29163bea0f79c81',ramdisk_id='',reservation_id='r-ncng8l0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1223626386',owner_user_name='tempest-DeleteServersTestJSON-1223626386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:07Z,user_data=None,user_id='f56fae1310544d9a8afb8f557d52b621',uuid=691738e9-227f-4f34-a56e-039c3380f179,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Converting VIF {"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:33:86,bridge_name='br-int',has_traffic_filtering=True,id=20276b2d-b468-4438-8434-648d3ca04e9c,network=Network(b7e221fd-bce7-4761-a4ef-7435e306d966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20276b2d-b4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG os_vif [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:33:86,bridge_name='br-int',has_traffic_filtering=True,id=20276b2d-b468-4438-8434-648d3ca04e9c,network=Network(b7e221fd-bce7-4761-a4ef-7435e306d966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20276b2d-b4') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Created schema index Interface.name {{(pid=75026) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Created schema index Port.name {{(pid=75026) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Created schema index Bridge.name {{(pid=75026) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Successfully updated port: acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [POLLOUT] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cd4a325-fbb0-5119-9df9-9079b87cbb1b', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:14 user nova-compute[75026]: INFO oslo.privsep.daemon [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpp_xp2hn_/privsep.sock']
Nov 10 19:16:14 user sudo[84366]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpp_xp2hn_/privsep.sock
Nov 10 19:16:14 user sudo[84366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Successfully updated port: 2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquired lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-3a6acdf0-4771-4d5e-9d7b-2835db0414aa req-0d945c40-1a11-4400-b850-a0e9a1bf88d5 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Received event network-changed-2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-3a6acdf0-4771-4d5e-9d7b-2835db0414aa req-0d945c40-1a11-4400-b850-a0e9a1bf88d5 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Refreshing instance network info cache due to event network-changed-2cd716fa-aa9c-433e-bfee-4a00514c51d5. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a6acdf0-4771-4d5e-9d7b-2835db0414aa req-0d945c40-1a11-4400-b850-a0e9a1bf88d5 service nova] Acquiring lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-44fe8541-a34f-4126-83a5-53758f82e1ee req-36f90bd2-75b1-4e59-9212-2f6461867df0 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Updated VIF entry in instance network info cache for port 20276b2d-b468-4438-8434-648d3ca04e9c. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-44fe8541-a34f-4126-83a5-53758f82e1ee req-36f90bd2-75b1-4e59-9212-2f6461867df0 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Updating instance_info_cache with network_info: [{"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-44fe8541-a34f-4126-83a5-53758f82e1ee req-36f90bd2-75b1-4e59-9212-2f6461867df0 service nova] Releasing lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance network_info: |[{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Start _get_guest_xml network_info=[{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:16:15 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:15 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.objects.instance [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lazy-loading 'pci_devices' on Instance uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:16:15 user nova-compute[75026]:   <uuid>01641144-84e2-49f1-9d09-6a15a9f42249</uuid>
Nov 10 19:16:15 user nova-compute[75026]:   <name>instance-00000002</name>
Nov 10 19:16:15 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:16:15 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:16:15 user nova-compute[75026]:   <metadata>
Nov 10 19:16:15 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:16:15 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:16:15 user nova-compute[75026]:       <nova:name>tempest-ServerActionsTestOtherB-server-451439939</nova:name>
Nov 10 19:16:15 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:16:15</nova:creationTime>
Nov 10 19:16:15 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:16:15 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:16:15 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:16:15 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:16:15 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:16:15 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:16:15 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:16:15 user nova-compute[75026]:       <nova:owner>
Nov 10 19:16:15 user nova-compute[75026]:         <nova:user uuid="c3955d2948c446c8b555fb7fea429581">tempest-ServerActionsTestOtherB-1354094982-project-member</nova:user>
Nov 10 19:16:15 user nova-compute[75026]:         <nova:project uuid="49d22011dbaa43728771bc3d1eefaa30">tempest-ServerActionsTestOtherB-1354094982</nova:project>
Nov 10 19:16:15 user nova-compute[75026]:       </nova:owner>
Nov 10 19:16:15 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:16:15 user nova-compute[75026]:       <nova:ports>
Nov 10 19:16:15 user nova-compute[75026]:         <nova:port uuid="acc7927d-7433-4d3b-a371-9b1433e46ee1">
Nov 10 19:16:15 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:16:15 user nova-compute[75026]:         </nova:port>
Nov 10 19:16:15 user nova-compute[75026]:       </nova:ports>
Nov 10 19:16:15 user nova-compute[75026]:     </nova:instance>
Nov 10 19:16:15 user nova-compute[75026]:   </metadata>
Nov 10 19:16:15 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:16:15 user nova-compute[75026]:     <system>
Nov 10 19:16:15 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:16:15 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:16:15 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:16:15 user nova-compute[75026]:       <entry name="serial">01641144-84e2-49f1-9d09-6a15a9f42249</entry>
Nov 10 19:16:15 user nova-compute[75026]:       <entry name="uuid">01641144-84e2-49f1-9d09-6a15a9f42249</entry>
Nov 10 19:16:15 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:16:15 user nova-compute[75026]:     </system>
Nov 10 19:16:15 user nova-compute[75026]:   </sysinfo>
Nov 10 19:16:15 user nova-compute[75026]:   <os>
Nov 10 19:16:15 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:16:15 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:16:15 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:16:15 user nova-compute[75026]:   </os>
Nov 10 19:16:15 user nova-compute[75026]:   <features>
Nov 10 19:16:15 user nova-compute[75026]:     <acpi/>
Nov 10 19:16:15 user nova-compute[75026]:     <apic/>
Nov 10 19:16:15 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:16:15 user nova-compute[75026]:   </features>
Nov 10 19:16:15 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:16:15 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:16:15 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:16:15 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:16:15 user nova-compute[75026]:   </clock>
Nov 10 19:16:15 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:16:15 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:16:15 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:16:15 user nova-compute[75026]:   </cpu>
Nov 10 19:16:15 user nova-compute[75026]:   <devices>
Nov 10 19:16:15 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:16:15 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:16:15 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk"/>
Nov 10 19:16:15 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:16:15 user nova-compute[75026]:     </disk>
Nov 10 19:16:15 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:16:15 user nova-compute[75026]:       <mac address="fa:16:3e:17:eb:e2"/>
Nov 10 19:16:15 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:15 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:16:15 user nova-compute[75026]:       <target dev="tapacc7927d-74"/>
Nov 10 19:16:15 user nova-compute[75026]:     </interface>
Nov 10 19:16:15 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:16:15 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/console.log" append="off"/>
Nov 10 19:16:15 user nova-compute[75026]:     </serial>
Nov 10 19:16:15 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:16:15 user nova-compute[75026]:     <video>
Nov 10 19:16:15 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:15 user nova-compute[75026]:     </video>
Nov 10 19:16:15 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:16:15 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:16:15 user nova-compute[75026]:     </rng>
Nov 10 19:16:15 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:16:15 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:16:15 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:16:15 user nova-compute[75026]:     </memballoon>
Nov 10 19:16:15 user nova-compute[75026]:   </devices>
Nov 10 19:16:15 user nova-compute[75026]: </domain>
Nov 10 19:16:15 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG os_vif [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b260c134-c22f-503e-9239-5058f034d778', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-1adaedb4-5913-4fd1-b803-a51c26353198 req-de4fe4c0-9388-43d3-9a55-abf2583ea397 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-changed-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-1adaedb4-5913-4fd1-b803-a51c26353198 req-de4fe4c0-9388-43d3-9a55-abf2583ea397 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Refreshing instance network info cache due to event network-changed-acc7927d-7433-4d3b-a371-9b1433e46ee1. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1adaedb4-5913-4fd1-b803-a51c26353198 req-de4fe4c0-9388-43d3-9a55-abf2583ea397 service nova] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1adaedb4-5913-4fd1-b803-a51c26353198 req-de4fe4c0-9388-43d3-9a55-abf2583ea397 service nova] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-1adaedb4-5913-4fd1-b803-a51c26353198 req-de4fe4c0-9388-43d3-9a55-abf2583ea397 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Refreshing network info cache for port acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updating instance_info_cache with network_info: [{"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Releasing lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Instance network_info: |[{"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a6acdf0-4771-4d5e-9d7b-2835db0414aa req-0d945c40-1a11-4400-b850-a0e9a1bf88d5 service nova] Acquired lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-3a6acdf0-4771-4d5e-9d7b-2835db0414aa req-0d945c40-1a11-4400-b850-a0e9a1bf88d5 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Refreshing network info cache for port 2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Start _get_guest_xml network_info=[{"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:16:16 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:16 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1629455314',display_name='tempest-ServersNegativeTestJSON-server-1629455314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1629455314',id=3,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d16cff5b9b94e95b61b63e8ffd25066',ramdisk_id='',reservation_id='r-na1sfunc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-527246051',owner_user_name='tempest-ServersNegativeTestJSON-527246051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:10Z,user_data=None,user_id='8448d842ea1f478392fbdb0c27afed56',uuid=31abf353-32fa-4b39-a2b3-02b63976b997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converting VIF {"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:c3:44,bridge_name='br-int',has_traffic_filtering=True,id=2cd716fa-aa9c-433e-bfee-4a00514c51d5,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd716fa-aa') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lazy-loading 'pci_devices' on Instance uuid 31abf353-32fa-4b39-a2b3-02b63976b997 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:16:16 user nova-compute[75026]:   <uuid>31abf353-32fa-4b39-a2b3-02b63976b997</uuid>
Nov 10 19:16:16 user nova-compute[75026]:   <name>instance-00000003</name>
Nov 10 19:16:16 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:16:16 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:16:16 user nova-compute[75026]:   <metadata>
Nov 10 19:16:16 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:16:16 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:16:16 user nova-compute[75026]:       <nova:name>tempest-ServersNegativeTestJSON-server-1629455314</nova:name>
Nov 10 19:16:16 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:16:16</nova:creationTime>
Nov 10 19:16:16 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:16:16 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:16:16 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:16:16 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:16:16 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:16:16 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:16:16 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:16:16 user nova-compute[75026]:       <nova:owner>
Nov 10 19:16:16 user nova-compute[75026]:         <nova:user uuid="8448d842ea1f478392fbdb0c27afed56">tempest-ServersNegativeTestJSON-527246051-project-member</nova:user>
Nov 10 19:16:16 user nova-compute[75026]:         <nova:project uuid="4d16cff5b9b94e95b61b63e8ffd25066">tempest-ServersNegativeTestJSON-527246051</nova:project>
Nov 10 19:16:16 user nova-compute[75026]:       </nova:owner>
Nov 10 19:16:16 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:16:16 user nova-compute[75026]:       <nova:ports>
Nov 10 19:16:16 user nova-compute[75026]:         <nova:port uuid="2cd716fa-aa9c-433e-bfee-4a00514c51d5">
Nov 10 19:16:16 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 19:16:16 user nova-compute[75026]:         </nova:port>
Nov 10 19:16:16 user nova-compute[75026]:       </nova:ports>
Nov 10 19:16:16 user nova-compute[75026]:     </nova:instance>
Nov 10 19:16:16 user nova-compute[75026]:   </metadata>
Nov 10 19:16:16 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:16:16 user nova-compute[75026]:     <system>
Nov 10 19:16:16 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:16:16 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:16:16 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:16:16 user nova-compute[75026]:       <entry name="serial">31abf353-32fa-4b39-a2b3-02b63976b997</entry>
Nov 10 19:16:16 user nova-compute[75026]:       <entry name="uuid">31abf353-32fa-4b39-a2b3-02b63976b997</entry>
Nov 10 19:16:16 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:16:16 user nova-compute[75026]:     </system>
Nov 10 19:16:16 user nova-compute[75026]:   </sysinfo>
Nov 10 19:16:16 user nova-compute[75026]:   <os>
Nov 10 19:16:16 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:16:16 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:16:16 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:16:16 user nova-compute[75026]:   </os>
Nov 10 19:16:16 user nova-compute[75026]:   <features>
Nov 10 19:16:16 user nova-compute[75026]:     <acpi/>
Nov 10 19:16:16 user nova-compute[75026]:     <apic/>
Nov 10 19:16:16 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:16:16 user nova-compute[75026]:   </features>
Nov 10 19:16:16 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:16:16 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:16:16 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:16:16 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:16:16 user nova-compute[75026]:   </clock>
Nov 10 19:16:16 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:16:16 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:16:16 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:16:16 user nova-compute[75026]:   </cpu>
Nov 10 19:16:16 user nova-compute[75026]:   <devices>
Nov 10 19:16:16 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:16:16 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:16:16 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk"/>
Nov 10 19:16:16 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:16:16 user nova-compute[75026]:     </disk>
Nov 10 19:16:16 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:16:16 user nova-compute[75026]:       <mac address="fa:16:3e:09:c3:44"/>
Nov 10 19:16:16 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:16 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:16:16 user nova-compute[75026]:       <target dev="tap2cd716fa-aa"/>
Nov 10 19:16:16 user nova-compute[75026]:     </interface>
Nov 10 19:16:16 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:16:16 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/console.log" append="off"/>
Nov 10 19:16:16 user nova-compute[75026]:     </serial>
Nov 10 19:16:16 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:16:16 user nova-compute[75026]:     <video>
Nov 10 19:16:16 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:16 user nova-compute[75026]:     </video>
Nov 10 19:16:16 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:16:16 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:16:16 user nova-compute[75026]:     </rng>
Nov 10 19:16:16 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:16:16 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:16:16 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:16:16 user nova-compute[75026]:     </memballoon>
Nov 10 19:16:16 user nova-compute[75026]:   </devices>
Nov 10 19:16:16 user nova-compute[75026]: </domain>
Nov 10 19:16:16 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1629455314',display_name='tempest-ServersNegativeTestJSON-server-1629455314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1629455314',id=3,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d16cff5b9b94e95b61b63e8ffd25066',ramdisk_id='',reservation_id='r-na1sfunc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-527246051',owner_user_name='tempest-ServersNegativeTestJSON-527246051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:10Z,user_data=None,user_id='8448d842ea1f478392fbdb0c27afed56',uuid=31abf353-32fa-4b39-a2b3-02b63976b997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converting VIF {"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:c3:44,bridge_name='br-int',has_traffic_filtering=True,id=2cd716fa-aa9c-433e-bfee-4a00514c51d5,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd716fa-aa') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG os_vif [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:c3:44,bridge_name='br-int',has_traffic_filtering=True,id=2cd716fa-aa9c-433e-bfee-4a00514c51d5,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd716fa-aa') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e2e0f95-cf6a-51f7-92d3-71c12b8d159c', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:16 user sudo[84366]: pam_unix(sudo:session): session closed for user root
Nov 10 19:16:16 user nova-compute[75026]: INFO oslo.privsep.daemon [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Spawned new privsep daemon via rootwrap
Nov 10 19:16:16 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 19:16:16 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 19:16:16 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 10 19:16:16 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84375
Nov 10 19:16:16 user nova-compute[75026]: WARNING oslo_privsep.priv_context [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] privsep daemon already running
Nov 10 19:16:16 user nova-compute[75026]: WARNING oslo_privsep.priv_context [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] privsep daemon already running
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-1adaedb4-5913-4fd1-b803-a51c26353198 req-de4fe4c0-9388-43d3-9a55-abf2583ea397 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updated VIF entry in instance network info cache for port acc7927d-7433-4d3b-a371-9b1433e46ee1. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-1adaedb4-5913-4fd1-b803-a51c26353198 req-de4fe4c0-9388-43d3-9a55-abf2583ea397 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1adaedb4-5913-4fd1-b803-a51c26353198 req-de4fe4c0-9388-43d3-9a55-abf2583ea397 service nova] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20276b2d-b4, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20276b2d-b4, col_values=(('qos', UUID('065daea2-3047-4356-8148-3e79f0c21394')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20276b2d-b4, col_values=(('external_ids', {'iface-id': '20276b2d-b468-4438-8434-648d3ca04e9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:33:86', 'vm-uuid': '691738e9-227f-4f34-a56e-039c3380f179'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:17 user nova-compute[75026]: INFO os_vif [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:33:86,bridge_name='br-int',has_traffic_filtering=True,id=20276b2d-b468-4438-8434-648d3ca04e9c,network=Network(b7e221fd-bce7-4761-a4ef-7435e306d966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20276b2d-b4')
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc7927d-74, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacc7927d-74, col_values=(('qos', UUID('ae66602b-81c1-40ce-bc40-da713fc7fba5')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacc7927d-74, col_values=(('external_ids', {'iface-id': 'acc7927d-7433-4d3b-a371-9b1433e46ee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:eb:e2', 'vm-uuid': '01641144-84e2-49f1-9d09-6a15a9f42249'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:17 user nova-compute[75026]: INFO os_vif [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74')
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cd716fa-aa, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cd716fa-aa, col_values=(('qos', UUID('08226f75-72d5-4a0c-b660-2c0f7b0c321b')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cd716fa-aa, col_values=(('external_ids', {'iface-id': '2cd716fa-aa9c-433e-bfee-4a00514c51d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:c3:44', 'vm-uuid': '31abf353-32fa-4b39-a2b3-02b63976b997'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:17 user nova-compute[75026]: INFO os_vif [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:c3:44,bridge_name='br-int',has_traffic_filtering=True,id=2cd716fa-aa9c-433e-bfee-4a00514c51d5,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd716fa-aa')
Nov 10 19:16:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] No VIF found with MAC fa:16:3e:8c:33:86, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] No VIF found with MAC fa:16:3e:17:eb:e2, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] No VIF found with MAC fa:16:3e:09:c3:44, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG nova.network.neutron [req-3a6acdf0-4771-4d5e-9d7b-2835db0414aa req-0d945c40-1a11-4400-b850-a0e9a1bf88d5 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updated VIF entry in instance network info cache for port 2cd716fa-aa9c-433e-bfee-4a00514c51d5. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG nova.network.neutron [req-3a6acdf0-4771-4d5e-9d7b-2835db0414aa req-0d945c40-1a11-4400-b850-a0e9a1bf88d5 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updating instance_info_cache with network_info: [{"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a6acdf0-4771-4d5e-9d7b-2835db0414aa req-0d945c40-1a11-4400-b850-a0e9a1bf88d5 service nova] Releasing lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:16:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Instance spawned successfully.
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:16:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Instance spawned successfully.
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:16:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance spawned successfully.
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:23 user nova-compute[75026]: INFO nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Took 16.40 seconds to spawn the instance on the hypervisor.
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:16:23 user nova-compute[75026]: INFO nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Took 14.03 seconds to spawn the instance on the hypervisor.
Nov 10 19:16:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:16:24 user nova-compute[75026]: INFO nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Took 14.66 seconds to spawn the instance on the hypervisor.
Nov 10 19:16:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:16:24 user nova-compute[75026]: INFO nova.compute.manager [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Took 18.09 seconds to build instance.
Nov 10 19:16:24 user nova-compute[75026]: INFO nova.compute.manager [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Took 15.16 seconds to build instance.
Nov 10 19:16:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b42b4815-ce72-4008-b8d3-36043b16435d tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.393s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:24 user nova-compute[75026]: INFO nova.compute.manager [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Took 16.08 seconds to build instance.
Nov 10 19:16:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d0997bd7-dc17-41ee-b76c-c6be134cb9b2 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "31abf353-32fa-4b39-a2b3-02b63976b997" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.333s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0604d354-dd6f-451e-998c-a6b99d503773 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.350s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG nova.compute.manager [req-f4bf0890-7559-474a-b597-c3c7f0282081 req-85e77045-2db8-41f4-ba71-2c057edcabf0 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received event network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f4bf0890-7559-474a-b597-c3c7f0282081 req-85e77045-2db8-41f4-ba71-2c057edcabf0 service nova] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f4bf0890-7559-474a-b597-c3c7f0282081 req-85e77045-2db8-41f4-ba71-2c057edcabf0 service nova] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f4bf0890-7559-474a-b597-c3c7f0282081 req-85e77045-2db8-41f4-ba71-2c057edcabf0 service nova] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG nova.compute.manager [req-f4bf0890-7559-474a-b597-c3c7f0282081 req-85e77045-2db8-41f4-ba71-2c057edcabf0 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] No waiting events found dispatching network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:25 user nova-compute[75026]: WARNING nova.compute.manager [req-f4bf0890-7559-474a-b597-c3c7f0282081 req-85e77045-2db8-41f4-ba71-2c057edcabf0 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received unexpected event network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c for instance with vm_state active and task_state None.
Nov 10 19:16:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:16:25 user nova-compute[75026]: INFO nova.compute.claims [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Claim successful on node user
Nov 10 19:16:26 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:16:26 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:16:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.975s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:16:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:16:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:16:26 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 10 19:16:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-194cea70-eea8-46e9-af04-a242e50da657 req-accda1d5-259e-4e54-ba1f-591e6d06e3de service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received event network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-194cea70-eea8-46e9-af04-a242e50da657 req-accda1d5-259e-4e54-ba1f-591e6d06e3de service nova] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-194cea70-eea8-46e9-af04-a242e50da657 req-accda1d5-259e-4e54-ba1f-591e6d06e3de service nova] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-194cea70-eea8-46e9-af04-a242e50da657 req-accda1d5-259e-4e54-ba1f-591e6d06e3de service nova] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-194cea70-eea8-46e9-af04-a242e50da657 req-accda1d5-259e-4e54-ba1f-591e6d06e3de service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] No waiting events found dispatching network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:27 user nova-compute[75026]: WARNING nova.compute.manager [req-194cea70-eea8-46e9-af04-a242e50da657 req-accda1d5-259e-4e54-ba1f-591e6d06e3de service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received unexpected event network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c for instance with vm_state active and task_state None.
Nov 10 19:16:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:16:27 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Creating image(s)
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "/opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "/opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "/opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG nova.policy [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45aeefe8fd764ef6a0742280b30e6c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293c2fa8bae04d4aafa2f16db1a5dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2.part --force-share --output=json" returned: 0 in 0.365s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG nova.virt.images [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] 282d1b03-0b88-437c-afd4-7193c214172d was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2.part /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2.part /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2.converted" returned: 0 in 0.349s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2.converted --force-share --output=json" returned: 0 in 0.309s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.680s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2 --force-share --output=json" returned: 0 in 0.278s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2 --force-share --output=json" returned: 0 in 0.359s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2,backing_fmt=raw /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2,backing_fmt=raw /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk 1073741824" returned: 0 in 0.101s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.472s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Successfully created port: 1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2 --force-share --output=json" returned: 0 in 0.327s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Cannot resize image /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Ensure instance console log exists: /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Successfully updated port: 1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:16:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquired lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-bfb068d6-33bd-4de9-be96-609f338a4281 req-2befcad3-ac8d-4cb8-9576-1b23444297b5 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-changed-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-bfb068d6-33bd-4de9-be96-609f338a4281 req-2befcad3-ac8d-4cb8-9576-1b23444297b5 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Refreshing instance network info cache due to event network-changed-1204de9a-a15a-41b6-90d3-b475a3fc9561. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfb068d6-33bd-4de9-be96-609f338a4281 req-2befcad3-ac8d-4cb8-9576-1b23444297b5 service nova] Acquiring lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Updating instance_info_cache with network_info: [{"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Releasing lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Instance network_info: |[{"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfb068d6-33bd-4de9-be96-609f338a4281 req-2befcad3-ac8d-4cb8-9576-1b23444297b5 service nova] Acquired lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfb068d6-33bd-4de9-be96-609f338a4281 req-2befcad3-ac8d-4cb8-9576-1b23444297b5 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Refreshing network info cache for port 1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Start _get_guest_xml network_info=[{"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:16:17Z,direct_url=<?>,disk_format='qcow2',id=282d1b03-0b88-437c-afd4-7193c214172d,min_disk=0,min_ram=0,name='',owner='f526b993d062474eac707f48e072defc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:16:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_name': '/dev/sda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': '282d1b03-0b88-437c-afd4-7193c214172d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-44f75669-cfe7-4166-bb60-bfac9f2160d0 req-00cb44b1-a20b-4e32-9bc0-74d5a041de7f service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Received event network-vif-plugged-2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-44f75669-cfe7-4166-bb60-bfac9f2160d0 req-00cb44b1-a20b-4e32-9bc0-74d5a041de7f service nova] Acquiring lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-44f75669-cfe7-4166-bb60-bfac9f2160d0 req-00cb44b1-a20b-4e32-9bc0-74d5a041de7f service nova] Lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-44f75669-cfe7-4166-bb60-bfac9f2160d0 req-00cb44b1-a20b-4e32-9bc0-74d5a041de7f service nova] Lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-44f75669-cfe7-4166-bb60-bfac9f2160d0 req-00cb44b1-a20b-4e32-9bc0-74d5a041de7f service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] No waiting events found dispatching network-vif-plugged-2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:32 user nova-compute[75026]: WARNING nova.compute.manager [req-44f75669-cfe7-4166-bb60-bfac9f2160d0 req-00cb44b1-a20b-4e32-9bc0-74d5a041de7f service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Received unexpected event network-vif-plugged-2cd716fa-aa9c-433e-bfee-4a00514c51d5 for instance with vm_state active and task_state None.
Nov 10 19:16:32 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:32 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:16:17Z,direct_url=<?>,disk_format='qcow2',id=282d1b03-0b88-437c-afd4-7193c214172d,min_disk=0,min_ram=0,name='',owner='f526b993d062474eac707f48e072defc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:16:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-278006354',display_name='tempest-AttachSCSIVolumeTestJSON-server-278006354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-278006354',id=4,image_ref='282d1b03-0b88-437c-afd4-7193c214172d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5a6rk/Bvm7Dx0ajqfT1NiDsEKSrB4IalFwLdkmIdGkYN8GQQ+EQmG6xzHzo3YAOYBuyNpzsio9/TQFX/rt/bbWl8jmhkQCdNshEL3JFqQmjFuhwQqAYD0HVQOTBF7eoQ==',key_name='tempest-keypair-483836031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='293c2fa8bae04d4aafa2f16db1a5dd8f',ramdisk_id='',reservation_id='r-d50yq7vc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='282d1b03-0b88-437c-afd4-7193c214172d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-948162593',owner_user_name='tempest-AttachSCSIVolumeTestJSON-948162593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45aeefe8fd764ef6a0742280b30e6c8a',uuid=766b49e2-52e5-4184-a870-0aa4e53f38ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Converting VIF {"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:81:23,bridge_name='br-int',has_traffic_filtering=True,id=1204de9a-a15a-41b6-90d3-b475a3fc9561,network=Network(75547ab8-06fc-4c97-a91d-1eff66a4aa3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1204de9a-a1') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.objects.instance [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lazy-loading 'pci_devices' on Instance uuid 766b49e2-52e5-4184-a870-0aa4e53f38ea {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:16:33 user nova-compute[75026]:   <uuid>766b49e2-52e5-4184-a870-0aa4e53f38ea</uuid>
Nov 10 19:16:33 user nova-compute[75026]:   <name>instance-00000004</name>
Nov 10 19:16:33 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:16:33 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:16:33 user nova-compute[75026]:   <metadata>
Nov 10 19:16:33 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:16:33 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:16:33 user nova-compute[75026]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-278006354</nova:name>
Nov 10 19:16:33 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:16:32</nova:creationTime>
Nov 10 19:16:33 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:16:33 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:16:33 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:16:33 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:16:33 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:16:33 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:16:33 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:16:33 user nova-compute[75026]:       <nova:owner>
Nov 10 19:16:33 user nova-compute[75026]:         <nova:user uuid="45aeefe8fd764ef6a0742280b30e6c8a">tempest-AttachSCSIVolumeTestJSON-948162593-project-member</nova:user>
Nov 10 19:16:33 user nova-compute[75026]:         <nova:project uuid="293c2fa8bae04d4aafa2f16db1a5dd8f">tempest-AttachSCSIVolumeTestJSON-948162593</nova:project>
Nov 10 19:16:33 user nova-compute[75026]:       </nova:owner>
Nov 10 19:16:33 user nova-compute[75026]:       <nova:root type="image" uuid="282d1b03-0b88-437c-afd4-7193c214172d"/>
Nov 10 19:16:33 user nova-compute[75026]:       <nova:ports>
Nov 10 19:16:33 user nova-compute[75026]:         <nova:port uuid="1204de9a-a15a-41b6-90d3-b475a3fc9561">
Nov 10 19:16:33 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 19:16:33 user nova-compute[75026]:         </nova:port>
Nov 10 19:16:33 user nova-compute[75026]:       </nova:ports>
Nov 10 19:16:33 user nova-compute[75026]:     </nova:instance>
Nov 10 19:16:33 user nova-compute[75026]:   </metadata>
Nov 10 19:16:33 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:16:33 user nova-compute[75026]:     <system>
Nov 10 19:16:33 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:16:33 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:16:33 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:16:33 user nova-compute[75026]:       <entry name="serial">766b49e2-52e5-4184-a870-0aa4e53f38ea</entry>
Nov 10 19:16:33 user nova-compute[75026]:       <entry name="uuid">766b49e2-52e5-4184-a870-0aa4e53f38ea</entry>
Nov 10 19:16:33 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:16:33 user nova-compute[75026]:     </system>
Nov 10 19:16:33 user nova-compute[75026]:   </sysinfo>
Nov 10 19:16:33 user nova-compute[75026]:   <os>
Nov 10 19:16:33 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:16:33 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:16:33 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:16:33 user nova-compute[75026]:   </os>
Nov 10 19:16:33 user nova-compute[75026]:   <features>
Nov 10 19:16:33 user nova-compute[75026]:     <acpi/>
Nov 10 19:16:33 user nova-compute[75026]:     <apic/>
Nov 10 19:16:33 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:16:33 user nova-compute[75026]:   </features>
Nov 10 19:16:33 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:16:33 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:16:33 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:16:33 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:16:33 user nova-compute[75026]:   </clock>
Nov 10 19:16:33 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:16:33 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:16:33 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:16:33 user nova-compute[75026]:   </cpu>
Nov 10 19:16:33 user nova-compute[75026]:   <devices>
Nov 10 19:16:33 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:16:33 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:16:33 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk"/>
Nov 10 19:16:33 user nova-compute[75026]:       <target dev="sda" bus="scsi"/>
Nov 10 19:16:33 user nova-compute[75026]:       <address type="drive" controller="0" unit="0"/>
Nov 10 19:16:33 user nova-compute[75026]:     </disk>
Nov 10 19:16:33 user nova-compute[75026]:     <disk type="file" device="cdrom">
Nov 10 19:16:33 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 19:16:33 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk.config"/>
Nov 10 19:16:33 user nova-compute[75026]:       <target dev="sdb" bus="scsi"/>
Nov 10 19:16:33 user nova-compute[75026]:       <address type="drive" controller="0" unit="1"/>
Nov 10 19:16:33 user nova-compute[75026]:     </disk>
Nov 10 19:16:33 user nova-compute[75026]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 10 19:16:33 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:16:33 user nova-compute[75026]:       <mac address="fa:16:3e:d6:81:23"/>
Nov 10 19:16:33 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:33 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:16:33 user nova-compute[75026]:       <target dev="tap1204de9a-a1"/>
Nov 10 19:16:33 user nova-compute[75026]:     </interface>
Nov 10 19:16:33 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:16:33 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/console.log" append="off"/>
Nov 10 19:16:33 user nova-compute[75026]:     </serial>
Nov 10 19:16:33 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:16:33 user nova-compute[75026]:     <video>
Nov 10 19:16:33 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:33 user nova-compute[75026]:     </video>
Nov 10 19:16:33 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:16:33 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:16:33 user nova-compute[75026]:     </rng>
Nov 10 19:16:33 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:16:33 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:16:33 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:16:33 user nova-compute[75026]:     </memballoon>
Nov 10 19:16:33 user nova-compute[75026]:   </devices>
Nov 10 19:16:33 user nova-compute[75026]: </domain>
Nov 10 19:16:33 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-278006354',display_name='tempest-AttachSCSIVolumeTestJSON-server-278006354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-278006354',id=4,image_ref='282d1b03-0b88-437c-afd4-7193c214172d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5a6rk/Bvm7Dx0ajqfT1NiDsEKSrB4IalFwLdkmIdGkYN8GQQ+EQmG6xzHzo3YAOYBuyNpzsio9/TQFX/rt/bbWl8jmhkQCdNshEL3JFqQmjFuhwQqAYD0HVQOTBF7eoQ==',key_name='tempest-keypair-483836031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='293c2fa8bae04d4aafa2f16db1a5dd8f',ramdisk_id='',reservation_id='r-d50yq7vc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='282d1b03-0b88-437c-afd4-7193c214172d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-948162593',owner_user_name='tempest-AttachSCSIVolumeTestJSON-948162593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45aeefe8fd764ef6a0742280b30e6c8a',uuid=766b49e2-52e5-4184-a870-0aa4e53f38ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Converting VIF {"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:81:23,bridge_name='br-int',has_traffic_filtering=True,id=1204de9a-a15a-41b6-90d3-b475a3fc9561,network=Network(75547ab8-06fc-4c97-a91d-1eff66a4aa3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1204de9a-a1') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG os_vif [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:81:23,bridge_name='br-int',has_traffic_filtering=True,id=1204de9a-a15a-41b6-90d3-b475a3fc9561,network=Network(75547ab8-06fc-4c97-a91d-1eff66a4aa3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1204de9a-a1') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b154178-6dba-5512-ad2b-76d3fa0c0c9a', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1204de9a-a1, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1204de9a-a1, col_values=(('qos', UUID('7939cf68-b3b5-4081-b87e-e44d5feb732d')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1204de9a-a1, col_values=(('external_ids', {'iface-id': '1204de9a-a15a-41b6-90d3-b475a3fc9561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:81:23', 'vm-uuid': '766b49e2-52e5-4184-a870-0aa4e53f38ea'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:33 user nova-compute[75026]: INFO os_vif [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:81:23,bridge_name='br-int',has_traffic_filtering=True,id=1204de9a-a15a-41b6-90d3-b475a3fc9561,network=Network(75547ab8-06fc-4c97-a91d-1eff66a4aa3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1204de9a-a1')
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] No BDM found with device name sda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] No VIF found with MAC fa:16:3e:d6:81:23, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:16:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Using config drive
Nov 10 19:16:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfb068d6-33bd-4de9-be96-609f338a4281 req-2befcad3-ac8d-4cb8-9576-1b23444297b5 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Updated VIF entry in instance network info cache for port 1204de9a-a15a-41b6-90d3-b475a3fc9561. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:16:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfb068d6-33bd-4de9-be96-609f338a4281 req-2befcad3-ac8d-4cb8-9576-1b23444297b5 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Updating instance_info_cache with network_info: [{"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:34 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Creating config drive at /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk.config
Nov 10 19:16:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo43mbmo4 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfb068d6-33bd-4de9-be96-609f338a4281 req-2befcad3-ac8d-4cb8-9576-1b23444297b5 service nova] Releasing lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo43mbmo4" returned: 0 in 0.082s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:16:35 user nova-compute[75026]: INFO nova.compute.claims [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Claim successful on node user
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-0794beca-a870-4b9d-9674-54cc6aa9f450 req-e1933b49-2716-4710-b1b1-ce7cd8ccfefc service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Received event network-vif-plugged-2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0794beca-a870-4b9d-9674-54cc6aa9f450 req-e1933b49-2716-4710-b1b1-ce7cd8ccfefc service nova] Acquiring lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0794beca-a870-4b9d-9674-54cc6aa9f450 req-e1933b49-2716-4710-b1b1-ce7cd8ccfefc service nova] Lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0794beca-a870-4b9d-9674-54cc6aa9f450 req-e1933b49-2716-4710-b1b1-ce7cd8ccfefc service nova] Lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-0794beca-a870-4b9d-9674-54cc6aa9f450 req-e1933b49-2716-4710-b1b1-ce7cd8ccfefc service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] No waiting events found dispatching network-vif-plugged-2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:35 user nova-compute[75026]: WARNING nova.compute.manager [req-0794beca-a870-4b9d-9674-54cc6aa9f450 req-e1933b49-2716-4710-b1b1-ce7cd8ccfefc service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Received unexpected event network-vif-plugged-2cd716fa-aa9c-433e-bfee-4a00514c51d5 for instance with vm_state active and task_state None.
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:16:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.policy [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2f78c518af14d6e84894f850811426b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89956906ad1943408b1783771ee6aa32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:16:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Creating image(s)
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "/opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "/opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "/opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.266s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.240s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk 1073741824" returned: 0 in 0.071s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.267s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:16:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Cannot resize image /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Ensure instance console log exists: /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-e10a07e8-02a6-429f-a6ef-a877888b5677 req-fabe3e6b-32f9-4375-b78e-9aef6083ecb4 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e10a07e8-02a6-429f-a6ef-a877888b5677 req-fabe3e6b-32f9-4375-b78e-9aef6083ecb4 service nova] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e10a07e8-02a6-429f-a6ef-a877888b5677 req-fabe3e6b-32f9-4375-b78e-9aef6083ecb4 service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e10a07e8-02a6-429f-a6ef-a877888b5677 req-fabe3e6b-32f9-4375-b78e-9aef6083ecb4 service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-e10a07e8-02a6-429f-a6ef-a877888b5677 req-fabe3e6b-32f9-4375-b78e-9aef6083ecb4 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] No waiting events found dispatching network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:37 user nova-compute[75026]: WARNING nova.compute.manager [req-e10a07e8-02a6-429f-a6ef-a877888b5677 req-fabe3e6b-32f9-4375-b78e-9aef6083ecb4 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received unexpected event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 for instance with vm_state building and task_state spawning.
Nov 10 19:16:37 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Successfully created port: f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Successfully updated port: f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquired lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updating instance_info_cache with network_info: [{"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Releasing lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Instance network_info: |[{"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Start _get_guest_xml network_info=[{"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:16:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556252477',display_name='tempest-VolumesAdminNegativeTest-server-1556252477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556252477',id=5,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7i/fp4Rin1cvWFPaUBVoXeuql5tIOQ/H0hw3h/ywJI5/5F9P05zCfXQLk+s/fcVdzlfngkADRf60/3wwOgqv//FYKD+8WoHl8x2HqCsAUibRod53UWk+G1SkutultlBw==',key_name='tempest-keypair-1621497382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89956906ad1943408b1783771ee6aa32',ramdisk_id='',reservation_id='r-0xvqp0xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1994864820',owner_user_name='tempest-VolumesAdminNegativeTest-1994864820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2f78c518af14d6e84894f850811426b',uuid=d57c5ada-750c-41af-a14c-6546374cf5d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converting VIF {"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:7f:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8c478bb-de4d-494b-bfff-497255329d99,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c478bb-de') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lazy-loading 'pci_devices' on Instance uuid d57c5ada-750c-41af-a14c-6546374cf5d2 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:16:38 user nova-compute[75026]:   <uuid>d57c5ada-750c-41af-a14c-6546374cf5d2</uuid>
Nov 10 19:16:38 user nova-compute[75026]:   <name>instance-00000005</name>
Nov 10 19:16:38 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:16:38 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:16:38 user nova-compute[75026]:   <metadata>
Nov 10 19:16:38 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:16:38 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:16:38 user nova-compute[75026]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1556252477</nova:name>
Nov 10 19:16:38 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:16:38</nova:creationTime>
Nov 10 19:16:38 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:16:38 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:16:38 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:16:38 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:16:38 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:16:38 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:16:38 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:16:38 user nova-compute[75026]:       <nova:owner>
Nov 10 19:16:38 user nova-compute[75026]:         <nova:user uuid="f2f78c518af14d6e84894f850811426b">tempest-VolumesAdminNegativeTest-1994864820-project-member</nova:user>
Nov 10 19:16:38 user nova-compute[75026]:         <nova:project uuid="89956906ad1943408b1783771ee6aa32">tempest-VolumesAdminNegativeTest-1994864820</nova:project>
Nov 10 19:16:38 user nova-compute[75026]:       </nova:owner>
Nov 10 19:16:38 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:16:38 user nova-compute[75026]:       <nova:ports>
Nov 10 19:16:38 user nova-compute[75026]:         <nova:port uuid="f8c478bb-de4d-494b-bfff-497255329d99">
Nov 10 19:16:38 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 19:16:38 user nova-compute[75026]:         </nova:port>
Nov 10 19:16:38 user nova-compute[75026]:       </nova:ports>
Nov 10 19:16:38 user nova-compute[75026]:     </nova:instance>
Nov 10 19:16:38 user nova-compute[75026]:   </metadata>
Nov 10 19:16:38 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:16:38 user nova-compute[75026]:     <system>
Nov 10 19:16:38 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:16:38 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:16:38 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:16:38 user nova-compute[75026]:       <entry name="serial">d57c5ada-750c-41af-a14c-6546374cf5d2</entry>
Nov 10 19:16:38 user nova-compute[75026]:       <entry name="uuid">d57c5ada-750c-41af-a14c-6546374cf5d2</entry>
Nov 10 19:16:38 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:16:38 user nova-compute[75026]:     </system>
Nov 10 19:16:38 user nova-compute[75026]:   </sysinfo>
Nov 10 19:16:38 user nova-compute[75026]:   <os>
Nov 10 19:16:38 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:16:38 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:16:38 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:16:38 user nova-compute[75026]:   </os>
Nov 10 19:16:38 user nova-compute[75026]:   <features>
Nov 10 19:16:38 user nova-compute[75026]:     <acpi/>
Nov 10 19:16:38 user nova-compute[75026]:     <apic/>
Nov 10 19:16:38 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:16:38 user nova-compute[75026]:   </features>
Nov 10 19:16:38 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:16:38 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:16:38 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:16:38 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:16:38 user nova-compute[75026]:   </clock>
Nov 10 19:16:38 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:16:38 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:16:38 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:16:38 user nova-compute[75026]:   </cpu>
Nov 10 19:16:38 user nova-compute[75026]:   <devices>
Nov 10 19:16:38 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:16:38 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:16:38 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk"/>
Nov 10 19:16:38 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:16:38 user nova-compute[75026]:     </disk>
Nov 10 19:16:38 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:16:38 user nova-compute[75026]:       <mac address="fa:16:3e:eb:7f:d2"/>
Nov 10 19:16:38 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:38 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:16:38 user nova-compute[75026]:       <target dev="tapf8c478bb-de"/>
Nov 10 19:16:38 user nova-compute[75026]:     </interface>
Nov 10 19:16:38 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:16:38 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/console.log" append="off"/>
Nov 10 19:16:38 user nova-compute[75026]:     </serial>
Nov 10 19:16:38 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:16:38 user nova-compute[75026]:     <video>
Nov 10 19:16:38 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:38 user nova-compute[75026]:     </video>
Nov 10 19:16:38 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:16:38 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:16:38 user nova-compute[75026]:     </rng>
Nov 10 19:16:38 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:16:38 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:16:38 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:16:38 user nova-compute[75026]:     </memballoon>
Nov 10 19:16:38 user nova-compute[75026]:   </devices>
Nov 10 19:16:38 user nova-compute[75026]: </domain>
Nov 10 19:16:38 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556252477',display_name='tempest-VolumesAdminNegativeTest-server-1556252477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556252477',id=5,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7i/fp4Rin1cvWFPaUBVoXeuql5tIOQ/H0hw3h/ywJI5/5F9P05zCfXQLk+s/fcVdzlfngkADRf60/3wwOgqv//FYKD+8WoHl8x2HqCsAUibRod53UWk+G1SkutultlBw==',key_name='tempest-keypair-1621497382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89956906ad1943408b1783771ee6aa32',ramdisk_id='',reservation_id='r-0xvqp0xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1994864820',owner_user_name='tempest-VolumesAdminNegativeTest-1994864820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2f78c518af14d6e84894f850811426b',uuid=d57c5ada-750c-41af-a14c-6546374cf5d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converting VIF {"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:7f:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8c478bb-de4d-494b-bfff-497255329d99,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c478bb-de') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG os_vif [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:7f:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8c478bb-de4d-494b-bfff-497255329d99,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c478bb-de') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e71742d-0910-5220-93d9-63c180638adc', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8c478bb-de, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8c478bb-de, col_values=(('qos', UUID('e294f850-fa63-4b80-b0c7-78e09ce5fd54')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8c478bb-de, col_values=(('external_ids', {'iface-id': 'f8c478bb-de4d-494b-bfff-497255329d99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:7f:d2', 'vm-uuid': 'd57c5ada-750c-41af-a14c-6546374cf5d2'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:38 user nova-compute[75026]: INFO os_vif [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:7f:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8c478bb-de4d-494b-bfff-497255329d99,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c478bb-de')
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] No VIF found with MAC fa:16:3e:eb:7f:d2, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:16:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Instance spawned successfully.
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] No waiting events found dispatching network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:39 user nova-compute[75026]: WARNING nova.compute.manager [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received unexpected event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 for instance with vm_state building and task_state spawning.
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received event network-changed-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Refreshing instance network info cache due to event network-changed-f8c478bb-de4d-494b-bfff-497255329d99. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] Acquiring lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] Acquired lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.network.neutron [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Refreshing network info cache for port f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:16:39 user nova-compute[75026]: INFO nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Took 12.00 seconds to spawn the instance on the hypervisor.
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:16:39 user nova-compute[75026]: INFO nova.compute.manager [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Took 13.70 seconds to build instance.
Nov 10 19:16:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bc3d472-1548-40f2-a617-a873788f32dd tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.913s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.network.neutron [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updated VIF entry in instance network info cache for port f8c478bb-de4d-494b-bfff-497255329d99. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG nova.network.neutron [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updating instance_info_cache with network_info: [{"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b9613393-a915-4d31-8501-02e2498ac5f1 req-9589c2dc-f12c-4e11-8405-026f82cdfae3 service nova] Releasing lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received event network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] No waiting events found dispatching network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:41 user nova-compute[75026]: WARNING nova.compute.manager [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received unexpected event network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 for instance with vm_state building and task_state spawning.
Nov 10 19:16:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received event network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] No waiting events found dispatching network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:41 user nova-compute[75026]: WARNING nova.compute.manager [req-05ae64c8-0e11-40ec-a71f-c6fa5de4fdf4 req-fec7cf34-10c1-44c6-96cc-83c68d707208 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received unexpected event network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 for instance with vm_state building and task_state spawning.
Nov 10 19:16:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:16:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Instance spawned successfully.
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:43 user nova-compute[75026]: INFO nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Took 7.93 seconds to spawn the instance on the hypervisor.
Nov 10 19:16:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:16:43 user nova-compute[75026]: INFO nova.compute.manager [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Took 8.98 seconds to build instance.
Nov 10 19:16:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2c3b671d-b8c2-4fdd-8af8-8f5581e0f5a1 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.138s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:16:45 user nova-compute[75026]: INFO nova.compute.claims [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Claim successful on node user
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:16:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.policy [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c44130de62f5424ea1182f89978ce67a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b882af2ac95d4e998aa57a51dd0c5d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:16:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Creating image(s)
Nov 10 19:16:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "/opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "/opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "/opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.227s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.217s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk 1073741824" returned: 0 in 0.075s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.273s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Successfully created port: e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Cannot resize image /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Ensure instance console log exists: /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Successfully updated port: e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquired lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-177f958c-52f5-46af-9e89-2f8fa783fec6 req-c19b4591-2509-4e39-84bd-53fedf40d59e service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received event network-changed-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-177f958c-52f5-46af-9e89-2f8fa783fec6 req-c19b4591-2509-4e39-84bd-53fedf40d59e service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Refreshing instance network info cache due to event network-changed-e362b1aa-9251-4e43-b3af-3c825324f644. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-177f958c-52f5-46af-9e89-2f8fa783fec6 req-c19b4591-2509-4e39-84bd-53fedf40d59e service nova] Acquiring lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:16:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Updating instance_info_cache with network_info: [{"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Releasing lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Instance network_info: |[{"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-177f958c-52f5-46af-9e89-2f8fa783fec6 req-c19b4591-2509-4e39-84bd-53fedf40d59e service nova] Acquired lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-177f958c-52f5-46af-9e89-2f8fa783fec6 req-c19b4591-2509-4e39-84bd-53fedf40d59e service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Refreshing network info cache for port e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Start _get_guest_xml network_info=[{"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:16:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1123706193',display_name='tempest-VolumesAssistedSnapshotsTest-server-1123706193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1123706193',id=6,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa77mg5u7kS1a5zU11kmyAYcs9vqpmTtIcALdLmeHQ0rVdhLyHlIuDLTS5zc3aYkx5CR7YDmyzcvjdex+SSOjROxtIs++dnyozZ+EQpixaNEAZ+Odbf41yuqJfvHbZ2rQ==',key_name='tempest-keypair-588512440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b882af2ac95d4e998aa57a51dd0c5d8e',ramdisk_id='',reservation_id='r-tklbfm2s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1956635969',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1956635969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c44130de62f5424ea1182f89978ce67a',uuid=09a67456-da2f-4478-8c9a-6cac0e505134,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Converting VIF {"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=e362b1aa-9251-4e43-b3af-3c825324f644,network=Network(cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape362b1aa-92') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.objects.instance [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lazy-loading 'pci_devices' on Instance uuid 09a67456-da2f-4478-8c9a-6cac0e505134 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:16:49 user nova-compute[75026]:   <uuid>09a67456-da2f-4478-8c9a-6cac0e505134</uuid>
Nov 10 19:16:49 user nova-compute[75026]:   <name>instance-00000006</name>
Nov 10 19:16:49 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:16:49 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:16:49 user nova-compute[75026]:   <metadata>
Nov 10 19:16:49 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:16:49 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:16:49 user nova-compute[75026]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1123706193</nova:name>
Nov 10 19:16:49 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:16:49</nova:creationTime>
Nov 10 19:16:49 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:16:49 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:16:49 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:16:49 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:16:49 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:16:49 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:16:49 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:16:49 user nova-compute[75026]:       <nova:owner>
Nov 10 19:16:49 user nova-compute[75026]:         <nova:user uuid="c44130de62f5424ea1182f89978ce67a">tempest-VolumesAssistedSnapshotsTest-1956635969-project-member</nova:user>
Nov 10 19:16:49 user nova-compute[75026]:         <nova:project uuid="b882af2ac95d4e998aa57a51dd0c5d8e">tempest-VolumesAssistedSnapshotsTest-1956635969</nova:project>
Nov 10 19:16:49 user nova-compute[75026]:       </nova:owner>
Nov 10 19:16:49 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:16:49 user nova-compute[75026]:       <nova:ports>
Nov 10 19:16:49 user nova-compute[75026]:         <nova:port uuid="e362b1aa-9251-4e43-b3af-3c825324f644">
Nov 10 19:16:49 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 19:16:49 user nova-compute[75026]:         </nova:port>
Nov 10 19:16:49 user nova-compute[75026]:       </nova:ports>
Nov 10 19:16:49 user nova-compute[75026]:     </nova:instance>
Nov 10 19:16:49 user nova-compute[75026]:   </metadata>
Nov 10 19:16:49 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:16:49 user nova-compute[75026]:     <system>
Nov 10 19:16:49 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:16:49 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:16:49 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:16:49 user nova-compute[75026]:       <entry name="serial">09a67456-da2f-4478-8c9a-6cac0e505134</entry>
Nov 10 19:16:49 user nova-compute[75026]:       <entry name="uuid">09a67456-da2f-4478-8c9a-6cac0e505134</entry>
Nov 10 19:16:49 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:16:49 user nova-compute[75026]:     </system>
Nov 10 19:16:49 user nova-compute[75026]:   </sysinfo>
Nov 10 19:16:49 user nova-compute[75026]:   <os>
Nov 10 19:16:49 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:16:49 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:16:49 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:16:49 user nova-compute[75026]:   </os>
Nov 10 19:16:49 user nova-compute[75026]:   <features>
Nov 10 19:16:49 user nova-compute[75026]:     <acpi/>
Nov 10 19:16:49 user nova-compute[75026]:     <apic/>
Nov 10 19:16:49 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:16:49 user nova-compute[75026]:   </features>
Nov 10 19:16:49 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:16:49 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:16:49 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:16:49 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:16:49 user nova-compute[75026]:   </clock>
Nov 10 19:16:49 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:16:49 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:16:49 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:16:49 user nova-compute[75026]:   </cpu>
Nov 10 19:16:49 user nova-compute[75026]:   <devices>
Nov 10 19:16:49 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:16:49 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:16:49 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk"/>
Nov 10 19:16:49 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:16:49 user nova-compute[75026]:     </disk>
Nov 10 19:16:49 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:16:49 user nova-compute[75026]:       <mac address="fa:16:3e:46:08:cd"/>
Nov 10 19:16:49 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:49 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:16:49 user nova-compute[75026]:       <target dev="tape362b1aa-92"/>
Nov 10 19:16:49 user nova-compute[75026]:     </interface>
Nov 10 19:16:49 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:16:49 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/console.log" append="off"/>
Nov 10 19:16:49 user nova-compute[75026]:     </serial>
Nov 10 19:16:49 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:16:49 user nova-compute[75026]:     <video>
Nov 10 19:16:49 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:49 user nova-compute[75026]:     </video>
Nov 10 19:16:49 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:16:49 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:16:49 user nova-compute[75026]:     </rng>
Nov 10 19:16:49 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:16:49 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:16:49 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:16:49 user nova-compute[75026]:     </memballoon>
Nov 10 19:16:49 user nova-compute[75026]:   </devices>
Nov 10 19:16:49 user nova-compute[75026]: </domain>
Nov 10 19:16:49 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1123706193',display_name='tempest-VolumesAssistedSnapshotsTest-server-1123706193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1123706193',id=6,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa77mg5u7kS1a5zU11kmyAYcs9vqpmTtIcALdLmeHQ0rVdhLyHlIuDLTS5zc3aYkx5CR7YDmyzcvjdex+SSOjROxtIs++dnyozZ+EQpixaNEAZ+Odbf41yuqJfvHbZ2rQ==',key_name='tempest-keypair-588512440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b882af2ac95d4e998aa57a51dd0c5d8e',ramdisk_id='',reservation_id='r-tklbfm2s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1956635969',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1956635969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c44130de62f5424ea1182f89978ce67a',uuid=09a67456-da2f-4478-8c9a-6cac0e505134,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Converting VIF {"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=e362b1aa-9251-4e43-b3af-3c825324f644,network=Network(cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape362b1aa-92') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG os_vif [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=e362b1aa-9251-4e43-b3af-3c825324f644,network=Network(cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape362b1aa-92') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '629537d8-0a55-5433-ba45-6f70e457080a', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape362b1aa-92, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape362b1aa-92, col_values=(('qos', UUID('dc979a1f-9a82-443e-b237-e21cd347935a')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape362b1aa-92, col_values=(('external_ids', {'iface-id': 'e362b1aa-9251-4e43-b3af-3c825324f644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:08:cd', 'vm-uuid': '09a67456-da2f-4478-8c9a-6cac0e505134'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:49 user nova-compute[75026]: INFO os_vif [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=e362b1aa-9251-4e43-b3af-3c825324f644,network=Network(cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape362b1aa-92')
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] No VIF found with MAC fa:16:3e:46:08:cd, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-177f958c-52f5-46af-9e89-2f8fa783fec6 req-c19b4591-2509-4e39-84bd-53fedf40d59e service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Updated VIF entry in instance network info cache for port e362b1aa-9251-4e43-b3af-3c825324f644. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-177f958c-52f5-46af-9e89-2f8fa783fec6 req-c19b4591-2509-4e39-84bd-53fedf40d59e service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Updating instance_info_cache with network_info: [{"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-177f958c-52f5-46af-9e89-2f8fa783fec6 req-c19b4591-2509-4e39-84bd-53fedf40d59e service nova] Releasing lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-ae453dfe-95fc-4964-83a0-752853bac57e req-895c14d7-5322-4a2d-9713-835a116c92b9 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ae453dfe-95fc-4964-83a0-752853bac57e req-895c14d7-5322-4a2d-9713-835a116c92b9 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ae453dfe-95fc-4964-83a0-752853bac57e req-895c14d7-5322-4a2d-9713-835a116c92b9 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ae453dfe-95fc-4964-83a0-752853bac57e req-895c14d7-5322-4a2d-9713-835a116c92b9 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-ae453dfe-95fc-4964-83a0-752853bac57e req-895c14d7-5322-4a2d-9713-835a116c92b9 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:50 user nova-compute[75026]: WARNING nova.compute.manager [req-ae453dfe-95fc-4964-83a0-752853bac57e req-895c14d7-5322-4a2d-9713-835a116c92b9 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state active and task_state None.
Nov 10 19:16:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-b01bd99a-d74d-49fa-8d39-e13b0860c282 req-daac3395-d7c5-41b0-88cc-9ab9e1363c79 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b01bd99a-d74d-49fa-8d39-e13b0860c282 req-daac3395-d7c5-41b0-88cc-9ab9e1363c79 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b01bd99a-d74d-49fa-8d39-e13b0860c282 req-daac3395-d7c5-41b0-88cc-9ab9e1363c79 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b01bd99a-d74d-49fa-8d39-e13b0860c282 req-daac3395-d7c5-41b0-88cc-9ab9e1363c79 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-b01bd99a-d74d-49fa-8d39-e13b0860c282 req-daac3395-d7c5-41b0-88cc-9ab9e1363c79 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:52 user nova-compute[75026]: WARNING nova.compute.manager [req-b01bd99a-d74d-49fa-8d39-e13b0860c282 req-daac3395-d7c5-41b0-88cc-9ab9e1363c79 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state active and task_state None.
Nov 10 19:16:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:16:53 user nova-compute[75026]: INFO nova.compute.claims [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Claim successful on node user
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:16:53 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:16:53 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Instance spawned successfully.
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.policy [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0eb014a1e2a42ce8f33dcf814421229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dc3afe879d475a96ad9312fec0c3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:16:54 user nova-compute[75026]: INFO nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Took 7.31 seconds to spawn the instance on the hypervisor.
Nov 10 19:16:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:16:54 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Creating image(s)
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:54 user nova-compute[75026]: INFO nova.compute.manager [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Took 8.43 seconds to build instance.
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eea8be59-22e4-4037-be6e-7c2033ae208d tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.580s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.226s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk 1073741824" returned: 0 in 0.132s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG nova.network.neutron [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Successfully created port: 8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:16:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:55 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Cannot resize image /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:16:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:16:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Ensure instance console log exists: /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:16:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.neutron [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Successfully updated port: 8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquired lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.neutron [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.compute.manager [req-ac2c7e9d-8f69-40f1-af59-f4a15c2d29c8 req-78b6f88f-0ab5-46be-b65a-7c47fbfae7ae service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-changed-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.compute.manager [req-ac2c7e9d-8f69-40f1-af59-f4a15c2d29c8 req-78b6f88f-0ab5-46be-b65a-7c47fbfae7ae service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Refreshing instance network info cache due to event network-changed-8f2f1337-bb4e-4cc0-892d-418b29969d56. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ac2c7e9d-8f69-40f1-af59-f4a15c2d29c8 req-78b6f88f-0ab5-46be-b65a-7c47fbfae7ae service nova] Acquiring lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.neutron [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.neutron [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating instance_info_cache with network_info: [{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Releasing lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Instance network_info: |[{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ac2c7e9d-8f69-40f1-af59-f4a15c2d29c8 req-78b6f88f-0ab5-46be-b65a-7c47fbfae7ae service nova] Acquired lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.neutron [req-ac2c7e9d-8f69-40f1-af59-f4a15c2d29c8 req-78b6f88f-0ab5-46be-b65a-7c47fbfae7ae service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Refreshing network info cache for port 8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Start _get_guest_xml network_info=[{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:16:56 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:56 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converting VIF {"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:9d:60,bridge_name='br-int',has_traffic_filtering=True,id=8f2f1337-bb4e-4cc0-892d-418b29969d56,network=Network(3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2f1337-bb') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.objects.instance [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:16:56 user nova-compute[75026]:   <uuid>4fc47635-99d4-47a8-a482-022d75931831</uuid>
Nov 10 19:16:56 user nova-compute[75026]:   <name>instance-00000007</name>
Nov 10 19:16:56 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:16:56 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:16:56 user nova-compute[75026]:   <metadata>
Nov 10 19:16:56 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:16:56 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:16:56 user nova-compute[75026]:       <nova:name>tempest-device-tagging-server-1709409501</nova:name>
Nov 10 19:16:56 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:16:56</nova:creationTime>
Nov 10 19:16:56 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:16:56 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:16:56 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:16:56 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:16:56 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:16:56 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:16:56 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:16:56 user nova-compute[75026]:       <nova:owner>
Nov 10 19:16:56 user nova-compute[75026]:         <nova:user uuid="a0eb014a1e2a42ce8f33dcf814421229">tempest-TaggedAttachmentsTest-617120050-project-member</nova:user>
Nov 10 19:16:56 user nova-compute[75026]:         <nova:project uuid="32dc3afe879d475a96ad9312fec0c3e9">tempest-TaggedAttachmentsTest-617120050</nova:project>
Nov 10 19:16:56 user nova-compute[75026]:       </nova:owner>
Nov 10 19:16:56 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:16:56 user nova-compute[75026]:       <nova:ports>
Nov 10 19:16:56 user nova-compute[75026]:         <nova:port uuid="8f2f1337-bb4e-4cc0-892d-418b29969d56">
Nov 10 19:16:56 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:16:56 user nova-compute[75026]:         </nova:port>
Nov 10 19:16:56 user nova-compute[75026]:       </nova:ports>
Nov 10 19:16:56 user nova-compute[75026]:     </nova:instance>
Nov 10 19:16:56 user nova-compute[75026]:   </metadata>
Nov 10 19:16:56 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:16:56 user nova-compute[75026]:     <system>
Nov 10 19:16:56 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:16:56 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:16:56 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:16:56 user nova-compute[75026]:       <entry name="serial">4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:16:56 user nova-compute[75026]:       <entry name="uuid">4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:16:56 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:16:56 user nova-compute[75026]:     </system>
Nov 10 19:16:56 user nova-compute[75026]:   </sysinfo>
Nov 10 19:16:56 user nova-compute[75026]:   <os>
Nov 10 19:16:56 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:16:56 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:16:56 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:16:56 user nova-compute[75026]:   </os>
Nov 10 19:16:56 user nova-compute[75026]:   <features>
Nov 10 19:16:56 user nova-compute[75026]:     <acpi/>
Nov 10 19:16:56 user nova-compute[75026]:     <apic/>
Nov 10 19:16:56 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:16:56 user nova-compute[75026]:   </features>
Nov 10 19:16:56 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:16:56 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:16:56 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:16:56 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:16:56 user nova-compute[75026]:   </clock>
Nov 10 19:16:56 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:16:56 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:16:56 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:16:56 user nova-compute[75026]:   </cpu>
Nov 10 19:16:56 user nova-compute[75026]:   <devices>
Nov 10 19:16:56 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:16:56 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:16:56 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk"/>
Nov 10 19:16:56 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:16:56 user nova-compute[75026]:     </disk>
Nov 10 19:16:56 user nova-compute[75026]:     <disk type="file" device="cdrom">
Nov 10 19:16:56 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 19:16:56 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.config"/>
Nov 10 19:16:56 user nova-compute[75026]:       <target dev="hda" bus="ide"/>
Nov 10 19:16:56 user nova-compute[75026]:     </disk>
Nov 10 19:16:56 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:16:56 user nova-compute[75026]:       <mac address="fa:16:3e:49:9d:60"/>
Nov 10 19:16:56 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:56 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:16:56 user nova-compute[75026]:       <target dev="tap8f2f1337-bb"/>
Nov 10 19:16:56 user nova-compute[75026]:     </interface>
Nov 10 19:16:56 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:16:56 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log" append="off"/>
Nov 10 19:16:56 user nova-compute[75026]:     </serial>
Nov 10 19:16:56 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:16:56 user nova-compute[75026]:     <video>
Nov 10 19:16:56 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:16:56 user nova-compute[75026]:     </video>
Nov 10 19:16:56 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:16:56 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:16:56 user nova-compute[75026]:     </rng>
Nov 10 19:16:56 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:16:56 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:16:56 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:16:56 user nova-compute[75026]:     </memballoon>
Nov 10 19:16:56 user nova-compute[75026]:   </devices>
Nov 10 19:16:56 user nova-compute[75026]: </domain>
Nov 10 19:16:56 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converting VIF {"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:9d:60,bridge_name='br-int',has_traffic_filtering=True,id=8f2f1337-bb4e-4cc0-892d-418b29969d56,network=Network(3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2f1337-bb') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG os_vif [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:9d:60,bridge_name='br-int',has_traffic_filtering=True,id=8f2f1337-bb4e-4cc0-892d-418b29969d56,network=Network(3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2f1337-bb') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa141a40-0fb7-533b-a64c-237a13241eae', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f2f1337-bb, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f2f1337-bb, col_values=(('qos', UUID('99f2911a-232b-43d5-aa5b-dd80f3058e4a')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f2f1337-bb, col_values=(('external_ids', {'iface-id': '8f2f1337-bb4e-4cc0-892d-418b29969d56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:9d:60', 'vm-uuid': '4fc47635-99d4-47a8-a482-022d75931831'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:56 user nova-compute[75026]: INFO os_vif [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:9d:60,bridge_name='br-int',has_traffic_filtering=True,id=8f2f1337-bb4e-4cc0-892d-418b29969d56,network=Network(3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2f1337-bb')
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No BDM found with device name hda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No VIF found with MAC fa:16:3e:49:9d:60, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:16:56 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Using config drive
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.compute.manager [req-e9990f62-421e-44b9-862c-e262ad74efb3 req-ead3296f-1062-4183-9fbe-48fcb8d83e95 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received event network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e9990f62-421e-44b9-862c-e262ad74efb3 req-ead3296f-1062-4183-9fbe-48fcb8d83e95 service nova] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e9990f62-421e-44b9-862c-e262ad74efb3 req-ead3296f-1062-4183-9fbe-48fcb8d83e95 service nova] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e9990f62-421e-44b9-862c-e262ad74efb3 req-ead3296f-1062-4183-9fbe-48fcb8d83e95 service nova] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:56 user nova-compute[75026]: DEBUG nova.compute.manager [req-e9990f62-421e-44b9-862c-e262ad74efb3 req-ead3296f-1062-4183-9fbe-48fcb8d83e95 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] No waiting events found dispatching network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:56 user nova-compute[75026]: WARNING nova.compute.manager [req-e9990f62-421e-44b9-862c-e262ad74efb3 req-ead3296f-1062-4183-9fbe-48fcb8d83e95 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received unexpected event network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 for instance with vm_state active and task_state None.
Nov 10 19:16:57 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Creating config drive at /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.config
Nov 10 19:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy6klxozp {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy6klxozp" returned: 0 in 0.076s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:16:57 user nova-compute[75026]: DEBUG nova.network.neutron [req-ac2c7e9d-8f69-40f1-af59-f4a15c2d29c8 req-78b6f88f-0ab5-46be-b65a-7c47fbfae7ae service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updated VIF entry in instance network info cache for port 8f2f1337-bb4e-4cc0-892d-418b29969d56. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:16:57 user nova-compute[75026]: DEBUG nova.network.neutron [req-ac2c7e9d-8f69-40f1-af59-f4a15c2d29c8 req-78b6f88f-0ab5-46be-b65a-7c47fbfae7ae service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating instance_info_cache with network_info: [{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ac2c7e9d-8f69-40f1-af59-f4a15c2d29c8 req-78b6f88f-0ab5-46be-b65a-7c47fbfae7ae service nova] Releasing lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:16:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.010s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG nova.compute.manager [req-3a0dfe94-e711-4129-9510-c9f543b2a88c req-12c720a2-cf1e-42b1-a573-91bd2568e74b service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received event network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a0dfe94-e711-4129-9510-c9f543b2a88c req-12c720a2-cf1e-42b1-a573-91bd2568e74b service nova] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a0dfe94-e711-4129-9510-c9f543b2a88c req-12c720a2-cf1e-42b1-a573-91bd2568e74b service nova] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a0dfe94-e711-4129-9510-c9f543b2a88c req-12c720a2-cf1e-42b1-a573-91bd2568e74b service nova] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:58 user nova-compute[75026]: DEBUG nova.compute.manager [req-3a0dfe94-e711-4129-9510-c9f543b2a88c req-12c720a2-cf1e-42b1-a573-91bd2568e74b service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] No waiting events found dispatching network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:58 user nova-compute[75026]: WARNING nova.compute.manager [req-3a0dfe94-e711-4129-9510-c9f543b2a88c req-12c720a2-cf1e-42b1-a573-91bd2568e74b service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received unexpected event network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 for instance with vm_state active and task_state None.
Nov 10 19:16:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-ce557208-459f-4c80-ba9d-25890e3c779d req-6c7a1bcf-bdbf-4db3-897c-64170e1c4a8e service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:16:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ce557208-459f-4c80-ba9d-25890e3c779d req-6c7a1bcf-bdbf-4db3-897c-64170e1c4a8e service nova] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:16:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ce557208-459f-4c80-ba9d-25890e3c779d req-6c7a1bcf-bdbf-4db3-897c-64170e1c4a8e service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:16:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ce557208-459f-4c80-ba9d-25890e3c779d req-6c7a1bcf-bdbf-4db3-897c-64170e1c4a8e service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:16:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-ce557208-459f-4c80-ba9d-25890e3c779d req-6c7a1bcf-bdbf-4db3-897c-64170e1c4a8e service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] No waiting events found dispatching network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:16:59 user nova-compute[75026]: WARNING nova.compute.manager [req-ce557208-459f-4c80-ba9d-25890e3c779d req-6c7a1bcf-bdbf-4db3-897c-64170e1c4a8e service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received unexpected event network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 for instance with vm_state building and task_state spawning.
Nov 10 19:16:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:16:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:16:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json" returned: 0 in 0.374s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa55526d-e77d-40b3-ac7e-d27e1aaba539 req-60b90876-f820-44c3-8c09-35956041c363 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa55526d-e77d-40b3-ac7e-d27e1aaba539 req-60b90876-f820-44c3-8c09-35956041c363 service nova] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa55526d-e77d-40b3-ac7e-d27e1aaba539 req-60b90876-f820-44c3-8c09-35956041c363 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa55526d-e77d-40b3-ac7e-d27e1aaba539 req-60b90876-f820-44c3-8c09-35956041c363 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa55526d-e77d-40b3-ac7e-d27e1aaba539 req-60b90876-f820-44c3-8c09-35956041c363 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] No waiting events found dispatching network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:17:01 user nova-compute[75026]: WARNING nova.compute.manager [req-aa55526d-e77d-40b3-ac7e-d27e1aaba539 req-60b90876-f820-44c3-8c09-35956041c363 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received unexpected event network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 for instance with vm_state building and task_state spawning.
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:17:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Instance spawned successfully.
Nov 10 19:17:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:02 user nova-compute[75026]: INFO nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Took 7.98 seconds to spawn the instance on the hypervisor.
Nov 10 19:17:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:02 user nova-compute[75026]: INFO nova.compute.manager [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Took 9.12 seconds to build instance.
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-956caf13-4a5c-4607-ab44-717c70b2fbee tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.265s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:17:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:17:03 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7912MB free_disk=25.773517608642578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:17:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 691738e9-227f-4f34-a56e-039c3380f179 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 766b49e2-52e5-4184-a870-0aa4e53f38ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance d57c5ada-750c-41af-a14c-6546374cf5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 09a67456-da2f-4478-8c9a-6cac0e505134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4fc47635-99d4-47a8-a482-022d75931831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:17:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.755s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 691738e9-227f-4f34-a56e-039c3380f179 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:17:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Updating instance_info_cache with network_info: [{"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-691738e9-227f-4f34-a56e-039c3380f179" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:17:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:17:23 user nova-compute[75026]: INFO nova.compute.claims [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Claim successful on node user
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:17:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG nova.network.neutron [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:17:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:17:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG nova.policy [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44e55eb3c65140088f483bfcdedf8e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4febdd151ece434e8b87c2e8d58eca28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:17:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Creating image(s)
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "/opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "/opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.220s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.255s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk 1073741824" returned: 0 in 0.054s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Successfully created port: 090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Cannot resize image /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Ensure instance console log exists: /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Successfully updated port: 090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquired lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.compute.manager [req-3dcc958e-e08a-4a30-a153-c0269d7eb35b req-f304a82d-dc31-452a-8657-209263c83993 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-changed-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.compute.manager [req-3dcc958e-e08a-4a30-a153-c0269d7eb35b req-f304a82d-dc31-452a-8657-209263c83993 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Refreshing instance network info cache due to event network-changed-090d3b60-38f6-47b6-84e4-1765dac2017e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3dcc958e-e08a-4a30-a153-c0269d7eb35b req-f304a82d-dc31-452a-8657-209263c83993 service nova] Acquiring lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:17:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Updating instance_info_cache with network_info: [{"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Releasing lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Instance network_info: |[{"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3dcc958e-e08a-4a30-a153-c0269d7eb35b req-f304a82d-dc31-452a-8657-209263c83993 service nova] Acquired lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-3dcc958e-e08a-4a30-a153-c0269d7eb35b req-f304a82d-dc31-452a-8657-209263c83993 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Refreshing network info cache for port 090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Start _get_guest_xml network_info=[{"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:17:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:17:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-74805575',display_name='tempest-TestVolumeSwap-server-74805575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-74805575',id=8,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmeq3t6czW/NihO5uZqv9Mxc4mj1Gq5oHqGqSB36IVM6ogtWoZRjBTNsvLmZM+hcf0VO69s7LuMgmowJOfKQb1wW2COPaGQIKxy0KKLxq/M1gp1Y5cUIlZKbr+6QRu/qg==',key_name='tempest-keypair-533869735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4febdd151ece434e8b87c2e8d58eca28',ramdisk_id='',reservation_id='r-b9atb19p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1859752726',owner_user_name='tempest-TestVolumeSwap-1859752726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e55eb3c65140088f483bfcdedf8e62',uuid=5ca3830d-1edf-4638-a5cf-6cf6efe37362,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Converting VIF {"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c1:db,bridge_name='br-int',has_traffic_filtering=True,id=090d3b60-38f6-47b6-84e4-1765dac2017e,network=Network(4da57252-b5af-4e2c-8591-14a2c2eb979f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090d3b60-38') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.objects.instance [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ca3830d-1edf-4638-a5cf-6cf6efe37362 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:17:26 user nova-compute[75026]:   <uuid>5ca3830d-1edf-4638-a5cf-6cf6efe37362</uuid>
Nov 10 19:17:26 user nova-compute[75026]:   <name>instance-00000008</name>
Nov 10 19:17:26 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:17:26 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:17:26 user nova-compute[75026]:   <metadata>
Nov 10 19:17:26 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:17:26 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:17:26 user nova-compute[75026]:       <nova:name>tempest-TestVolumeSwap-server-74805575</nova:name>
Nov 10 19:17:26 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:17:26</nova:creationTime>
Nov 10 19:17:26 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:17:26 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:17:26 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:17:26 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:17:26 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:17:26 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:17:26 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:17:26 user nova-compute[75026]:       <nova:owner>
Nov 10 19:17:26 user nova-compute[75026]:         <nova:user uuid="44e55eb3c65140088f483bfcdedf8e62">tempest-TestVolumeSwap-1859752726-project-member</nova:user>
Nov 10 19:17:26 user nova-compute[75026]:         <nova:project uuid="4febdd151ece434e8b87c2e8d58eca28">tempest-TestVolumeSwap-1859752726</nova:project>
Nov 10 19:17:26 user nova-compute[75026]:       </nova:owner>
Nov 10 19:17:26 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:17:26 user nova-compute[75026]:       <nova:ports>
Nov 10 19:17:26 user nova-compute[75026]:         <nova:port uuid="090d3b60-38f6-47b6-84e4-1765dac2017e">
Nov 10 19:17:26 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:17:26 user nova-compute[75026]:         </nova:port>
Nov 10 19:17:26 user nova-compute[75026]:       </nova:ports>
Nov 10 19:17:26 user nova-compute[75026]:     </nova:instance>
Nov 10 19:17:26 user nova-compute[75026]:   </metadata>
Nov 10 19:17:26 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:17:26 user nova-compute[75026]:     <system>
Nov 10 19:17:26 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:17:26 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:17:26 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:17:26 user nova-compute[75026]:       <entry name="serial">5ca3830d-1edf-4638-a5cf-6cf6efe37362</entry>
Nov 10 19:17:26 user nova-compute[75026]:       <entry name="uuid">5ca3830d-1edf-4638-a5cf-6cf6efe37362</entry>
Nov 10 19:17:26 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:17:26 user nova-compute[75026]:     </system>
Nov 10 19:17:26 user nova-compute[75026]:   </sysinfo>
Nov 10 19:17:26 user nova-compute[75026]:   <os>
Nov 10 19:17:26 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:17:26 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:17:26 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:17:26 user nova-compute[75026]:   </os>
Nov 10 19:17:26 user nova-compute[75026]:   <features>
Nov 10 19:17:26 user nova-compute[75026]:     <acpi/>
Nov 10 19:17:26 user nova-compute[75026]:     <apic/>
Nov 10 19:17:26 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:17:26 user nova-compute[75026]:   </features>
Nov 10 19:17:26 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:17:26 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:17:26 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:17:26 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:17:26 user nova-compute[75026]:   </clock>
Nov 10 19:17:26 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:17:26 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:17:26 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:17:26 user nova-compute[75026]:   </cpu>
Nov 10 19:17:26 user nova-compute[75026]:   <devices>
Nov 10 19:17:26 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:17:26 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:17:26 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk"/>
Nov 10 19:17:26 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:17:26 user nova-compute[75026]:     </disk>
Nov 10 19:17:26 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:17:26 user nova-compute[75026]:       <mac address="fa:16:3e:4f:c1:db"/>
Nov 10 19:17:26 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:17:26 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:17:26 user nova-compute[75026]:       <target dev="tap090d3b60-38"/>
Nov 10 19:17:26 user nova-compute[75026]:     </interface>
Nov 10 19:17:26 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:17:26 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/console.log" append="off"/>
Nov 10 19:17:26 user nova-compute[75026]:     </serial>
Nov 10 19:17:26 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:17:26 user nova-compute[75026]:     <video>
Nov 10 19:17:26 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:17:26 user nova-compute[75026]:     </video>
Nov 10 19:17:26 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:17:26 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:17:26 user nova-compute[75026]:     </rng>
Nov 10 19:17:26 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:17:26 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:17:26 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:17:26 user nova-compute[75026]:     </memballoon>
Nov 10 19:17:26 user nova-compute[75026]:   </devices>
Nov 10 19:17:26 user nova-compute[75026]: </domain>
Nov 10 19:17:26 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-74805575',display_name='tempest-TestVolumeSwap-server-74805575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-74805575',id=8,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmeq3t6czW/NihO5uZqv9Mxc4mj1Gq5oHqGqSB36IVM6ogtWoZRjBTNsvLmZM+hcf0VO69s7LuMgmowJOfKQb1wW2COPaGQIKxy0KKLxq/M1gp1Y5cUIlZKbr+6QRu/qg==',key_name='tempest-keypair-533869735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4febdd151ece434e8b87c2e8d58eca28',ramdisk_id='',reservation_id='r-b9atb19p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1859752726',owner_user_name='tempest-TestVolumeSwap-1859752726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e55eb3c65140088f483bfcdedf8e62',uuid=5ca3830d-1edf-4638-a5cf-6cf6efe37362,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Converting VIF {"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c1:db,bridge_name='br-int',has_traffic_filtering=True,id=090d3b60-38f6-47b6-84e4-1765dac2017e,network=Network(4da57252-b5af-4e2c-8591-14a2c2eb979f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090d3b60-38') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG os_vif [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c1:db,bridge_name='br-int',has_traffic_filtering=True,id=090d3b60-38f6-47b6-84e4-1765dac2017e,network=Network(4da57252-b5af-4e2c-8591-14a2c2eb979f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090d3b60-38') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '734ee1e1-42a8-5bfd-922b-fa9986d14a99', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap090d3b60-38, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap090d3b60-38, col_values=(('qos', UUID('8e789459-2919-4bef-9ad8-077d524a0ef3')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap090d3b60-38, col_values=(('external_ids', {'iface-id': '090d3b60-38f6-47b6-84e4-1765dac2017e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:c1:db', 'vm-uuid': '5ca3830d-1edf-4638-a5cf-6cf6efe37362'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:26 user nova-compute[75026]: INFO os_vif [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c1:db,bridge_name='br-int',has_traffic_filtering=True,id=090d3b60-38f6-47b6-84e4-1765dac2017e,network=Network(4da57252-b5af-4e2c-8591-14a2c2eb979f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090d3b60-38')
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] No VIF found with MAC fa:16:3e:4f:c1:db, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-3dcc958e-e08a-4a30-a153-c0269d7eb35b req-f304a82d-dc31-452a-8657-209263c83993 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Updated VIF entry in instance network info cache for port 090d3b60-38f6-47b6-84e4-1765dac2017e. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-3dcc958e-e08a-4a30-a153-c0269d7eb35b req-f304a82d-dc31-452a-8657-209263c83993 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Updating instance_info_cache with network_info: [{"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:17:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3dcc958e-e08a-4a30-a153-c0269d7eb35b req-f304a82d-dc31-452a-8657-209263c83993 service nova] Releasing lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:17:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f3dae9f-16c4-426a-8446-ff7bffaefca4 req-3c0a26b3-2ed9-4fe5-b080-f3ed351451b3 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f3dae9f-16c4-426a-8446-ff7bffaefca4 req-3c0a26b3-2ed9-4fe5-b080-f3ed351451b3 service nova] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f3dae9f-16c4-426a-8446-ff7bffaefca4 req-3c0a26b3-2ed9-4fe5-b080-f3ed351451b3 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f3dae9f-16c4-426a-8446-ff7bffaefca4 req-3c0a26b3-2ed9-4fe5-b080-f3ed351451b3 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f3dae9f-16c4-426a-8446-ff7bffaefca4 req-3c0a26b3-2ed9-4fe5-b080-f3ed351451b3 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] No waiting events found dispatching network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:17:28 user nova-compute[75026]: WARNING nova.compute.manager [req-8f3dae9f-16c4-426a-8446-ff7bffaefca4 req-3c0a26b3-2ed9-4fe5-b080-f3ed351451b3 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received unexpected event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e for instance with vm_state building and task_state spawning.
Nov 10 19:17:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-3052da94-532c-49ec-a77c-0374cc5eaa17 req-d3ea5040-f373-45fa-8ecf-f7f908c9f09d service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3052da94-532c-49ec-a77c-0374cc5eaa17 req-d3ea5040-f373-45fa-8ecf-f7f908c9f09d service nova] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3052da94-532c-49ec-a77c-0374cc5eaa17 req-d3ea5040-f373-45fa-8ecf-f7f908c9f09d service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3052da94-532c-49ec-a77c-0374cc5eaa17 req-d3ea5040-f373-45fa-8ecf-f7f908c9f09d service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-3052da94-532c-49ec-a77c-0374cc5eaa17 req-d3ea5040-f373-45fa-8ecf-f7f908c9f09d service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] No waiting events found dispatching network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:17:30 user nova-compute[75026]: WARNING nova.compute.manager [req-3052da94-532c-49ec-a77c-0374cc5eaa17 req-d3ea5040-f373-45fa-8ecf-f7f908c9f09d service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received unexpected event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e for instance with vm_state building and task_state spawning.
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:17:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Instance spawned successfully.
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:30 user nova-compute[75026]: INFO nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 10 19:17:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:17:30 user nova-compute[75026]: INFO nova.compute.manager [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Took 7.13 seconds to build instance.
Nov 10 19:17:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8cd786a5-ff04-4cb8-95de-6d9e0b33c6bd tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.261s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "e83d61e5-b030-4353-9355-d83875c3be36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "e83d61e5-b030-4353-9355-d83875c3be36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:17:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:17:39 user nova-compute[75026]: INFO nova.compute.claims [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Claim successful on node user
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:17:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:17:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Creating image(s)
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "/opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "/opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "/opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.policy [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c0c6d9ac01c4ae5af13cbd390a08a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7ecfc0fa084a4dbb43afdb4ec96598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.226s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:17:40 user nova-compute[75026]: INFO nova.compute.claims [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Claim successful on node user
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk 1073741824" returned: 0 in 0.055s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.210s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Successfully created port: 666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Cannot resize image /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Ensure instance console log exists: /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:17:41 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:17:41 user nova-compute[75026]: DEBUG nova.policy [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e249c4693e7f4301b7ee850a0a2a3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4d825c26084145af53ad27bb9ebcec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:17:41 user nova-compute[75026]: INFO nova.virt.block_device [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Booting with volume 277e5d4b-3d2c-487d-9525-c2152138cb88 at /dev/vda
Nov 10 19:17:41 user nova-compute[75026]: DEBUG os_brick.utils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:17:41 user nova-compute[75026]: INFO oslo.privsep.daemon [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5gek06qa/privsep.sock']
Nov 10 19:17:41 user sudo[86087]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5gek06qa/privsep.sock
Nov 10 19:17:41 user sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Successfully updated port: 666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "refresh_cache-e83d61e5-b030-4353-9355-d83875c3be36" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquired lock "refresh_cache-e83d61e5-b030-4353-9355-d83875c3be36" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-5b35cea7-43f9-4065-9d27-4bd91b161f05 req-2ba481a6-696f-49ab-b5e5-e626f7efc8e6 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received event network-changed-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-5b35cea7-43f9-4065-9d27-4bd91b161f05 req-2ba481a6-696f-49ab-b5e5-e626f7efc8e6 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Refreshing instance network info cache due to event network-changed-666d2984-3003-4e57-9c66-042fa756843a. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5b35cea7-43f9-4065-9d27-4bd91b161f05 req-2ba481a6-696f-49ab-b5e5-e626f7efc8e6 service nova] Acquiring lock "refresh_cache-e83d61e5-b030-4353-9355-d83875c3be36" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Successfully created port: 4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Updating instance_info_cache with network_info: [{"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Releasing lock "refresh_cache-e83d61e5-b030-4353-9355-d83875c3be36" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Instance network_info: |[{"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5b35cea7-43f9-4065-9d27-4bd91b161f05 req-2ba481a6-696f-49ab-b5e5-e626f7efc8e6 service nova] Acquired lock "refresh_cache-e83d61e5-b030-4353-9355-d83875c3be36" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-5b35cea7-43f9-4065-9d27-4bd91b161f05 req-2ba481a6-696f-49ab-b5e5-e626f7efc8e6 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Refreshing network info cache for port 666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Start _get_guest_xml network_info=[{"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:17:42 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:17:42 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-961534194',display_name='tempest-VolumesNegativeTest-instance-961534194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-961534194',id=9,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e7ecfc0fa084a4dbb43afdb4ec96598',ramdisk_id='',reservation_id='r-lk50u5q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1538555898',owner_user_name='tempest-VolumesNegativeTest-1538555898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:17:40Z,user_data=None,user_id='4c0c6d9ac01c4ae5af13cbd390a08a1c',uuid=e83d61e5-b030-4353-9355-d83875c3be36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Converting VIF {"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:88:46,bridge_name='br-int',has_traffic_filtering=True,id=666d2984-3003-4e57-9c66-042fa756843a,network=Network(962b1910-e0d7-4672-adf8-d7a110f3af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666d2984-30') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.objects.instance [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lazy-loading 'pci_devices' on Instance uuid e83d61e5-b030-4353-9355-d83875c3be36 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:17:42 user nova-compute[75026]:   <uuid>e83d61e5-b030-4353-9355-d83875c3be36</uuid>
Nov 10 19:17:42 user nova-compute[75026]:   <name>instance-00000009</name>
Nov 10 19:17:42 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:17:42 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:17:42 user nova-compute[75026]:   <metadata>
Nov 10 19:17:42 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:17:42 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:17:42 user nova-compute[75026]:       <nova:name>tempest-VolumesNegativeTest-instance-961534194</nova:name>
Nov 10 19:17:42 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:17:42</nova:creationTime>
Nov 10 19:17:42 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:17:42 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:17:42 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:17:42 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:17:42 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:17:42 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:17:42 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:17:42 user nova-compute[75026]:       <nova:owner>
Nov 10 19:17:42 user nova-compute[75026]:         <nova:user uuid="4c0c6d9ac01c4ae5af13cbd390a08a1c">tempest-VolumesNegativeTest-1538555898-project-member</nova:user>
Nov 10 19:17:42 user nova-compute[75026]:         <nova:project uuid="9e7ecfc0fa084a4dbb43afdb4ec96598">tempest-VolumesNegativeTest-1538555898</nova:project>
Nov 10 19:17:42 user nova-compute[75026]:       </nova:owner>
Nov 10 19:17:42 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:17:42 user nova-compute[75026]:       <nova:ports>
Nov 10 19:17:42 user nova-compute[75026]:         <nova:port uuid="666d2984-3003-4e57-9c66-042fa756843a">
Nov 10 19:17:42 user nova-compute[75026]:           <nova:ip type="fixed" address="192.168.233.125" ipVersion="4"/>
Nov 10 19:17:42 user nova-compute[75026]:         </nova:port>
Nov 10 19:17:42 user nova-compute[75026]:       </nova:ports>
Nov 10 19:17:42 user nova-compute[75026]:     </nova:instance>
Nov 10 19:17:42 user nova-compute[75026]:   </metadata>
Nov 10 19:17:42 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:17:42 user nova-compute[75026]:     <system>
Nov 10 19:17:42 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:17:42 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:17:42 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:17:42 user nova-compute[75026]:       <entry name="serial">e83d61e5-b030-4353-9355-d83875c3be36</entry>
Nov 10 19:17:42 user nova-compute[75026]:       <entry name="uuid">e83d61e5-b030-4353-9355-d83875c3be36</entry>
Nov 10 19:17:42 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:17:42 user nova-compute[75026]:     </system>
Nov 10 19:17:42 user nova-compute[75026]:   </sysinfo>
Nov 10 19:17:42 user nova-compute[75026]:   <os>
Nov 10 19:17:42 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:17:42 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:17:42 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:17:42 user nova-compute[75026]:   </os>
Nov 10 19:17:42 user nova-compute[75026]:   <features>
Nov 10 19:17:42 user nova-compute[75026]:     <acpi/>
Nov 10 19:17:42 user nova-compute[75026]:     <apic/>
Nov 10 19:17:42 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:17:42 user nova-compute[75026]:   </features>
Nov 10 19:17:42 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:17:42 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:17:42 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:17:42 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:17:42 user nova-compute[75026]:   </clock>
Nov 10 19:17:42 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:17:42 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:17:42 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:17:42 user nova-compute[75026]:   </cpu>
Nov 10 19:17:42 user nova-compute[75026]:   <devices>
Nov 10 19:17:42 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:17:42 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:17:42 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk"/>
Nov 10 19:17:42 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:17:42 user nova-compute[75026]:     </disk>
Nov 10 19:17:42 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:17:42 user nova-compute[75026]:       <mac address="fa:16:3e:79:88:46"/>
Nov 10 19:17:42 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:17:42 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:17:42 user nova-compute[75026]:       <target dev="tap666d2984-30"/>
Nov 10 19:17:42 user nova-compute[75026]:     </interface>
Nov 10 19:17:42 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:17:42 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/console.log" append="off"/>
Nov 10 19:17:42 user nova-compute[75026]:     </serial>
Nov 10 19:17:42 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:17:42 user nova-compute[75026]:     <video>
Nov 10 19:17:42 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:17:42 user nova-compute[75026]:     </video>
Nov 10 19:17:42 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:17:42 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:17:42 user nova-compute[75026]:     </rng>
Nov 10 19:17:42 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:17:42 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:17:42 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:17:42 user nova-compute[75026]:     </memballoon>
Nov 10 19:17:42 user nova-compute[75026]:   </devices>
Nov 10 19:17:42 user nova-compute[75026]: </domain>
Nov 10 19:17:42 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-961534194',display_name='tempest-VolumesNegativeTest-instance-961534194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-961534194',id=9,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e7ecfc0fa084a4dbb43afdb4ec96598',ramdisk_id='',reservation_id='r-lk50u5q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1538555898',owner_user_name='tempest-VolumesNegativeTest-1538555898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:17:40Z,user_data=None,user_id='4c0c6d9ac01c4ae5af13cbd390a08a1c',uuid=e83d61e5-b030-4353-9355-d83875c3be36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Converting VIF {"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:88:46,bridge_name='br-int',has_traffic_filtering=True,id=666d2984-3003-4e57-9c66-042fa756843a,network=Network(962b1910-e0d7-4672-adf8-d7a110f3af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666d2984-30') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG os_vif [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:88:46,bridge_name='br-int',has_traffic_filtering=True,id=666d2984-3003-4e57-9c66-042fa756843a,network=Network(962b1910-e0d7-4672-adf8-d7a110f3af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666d2984-30') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9197b4ce-7a8f-5c46-bb5c-4b1e8811a296', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap666d2984-30, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap666d2984-30, col_values=(('qos', UUID('a805c17b-b710-480d-9b3d-6c3cc3e3aaff')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap666d2984-30, col_values=(('external_ids', {'iface-id': '666d2984-3003-4e57-9c66-042fa756843a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:88:46', 'vm-uuid': 'e83d61e5-b030-4353-9355-d83875c3be36'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:42 user nova-compute[75026]: INFO os_vif [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:88:46,bridge_name='br-int',has_traffic_filtering=True,id=666d2984-3003-4e57-9c66-042fa756843a,network=Network(962b1910-e0d7-4672-adf8-d7a110f3af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666d2984-30')
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] No VIF found with MAC fa:16:3e:79:88:46, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Successfully updated port: 4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquired lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-2c922039-d41f-4b3d-931e-63e378cef023 req-3e9fb272-8991-4203-ac8a-fc4e21b2433c service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received event network-changed-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-2c922039-d41f-4b3d-931e-63e378cef023 req-3e9fb272-8991-4203-ac8a-fc4e21b2433c service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Refreshing instance network info cache due to event network-changed-4d4b1476-7a64-4370-aa6c-71afdb5ca843. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2c922039-d41f-4b3d-931e-63e378cef023 req-3e9fb272-8991-4203-ac8a-fc4e21b2433c service nova] Acquiring lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:17:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-5b35cea7-43f9-4065-9d27-4bd91b161f05 req-2ba481a6-696f-49ab-b5e5-e626f7efc8e6 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Updated VIF entry in instance network info cache for port 666d2984-3003-4e57-9c66-042fa756843a. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-5b35cea7-43f9-4065-9d27-4bd91b161f05 req-2ba481a6-696f-49ab-b5e5-e626f7efc8e6 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Updating instance_info_cache with network_info: [{"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5b35cea7-43f9-4065-9d27-4bd91b161f05 req-2ba481a6-696f-49ab-b5e5-e626f7efc8e6 service nova] Releasing lock "refresh_cache-e83d61e5-b030-4353-9355-d83875c3be36" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG nova.network.neutron [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updating instance_info_cache with network_info: [{"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Releasing lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Instance network_info: |[{"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2c922039-d41f-4b3d-931e-63e378cef023 req-3e9fb272-8991-4203-ac8a-fc4e21b2433c service nova] Acquired lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-2c922039-d41f-4b3d-931e-63e378cef023 req-3e9fb272-8991-4203-ac8a-fc4e21b2433c service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Refreshing network info cache for port 4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:17:43 user nova-compute[75026]: INFO oslo.privsep.daemon [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Spawned new privsep daemon via rootwrap
Nov 10 19:17:43 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 19:17:43 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 19:17:43 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 10 19:17:43 user nova-compute[75026]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86097
Nov 10 19:17:43 user sudo[86087]: pam_unix(sudo:session): session closed for user root
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c2621-68f0-439f-a631-79a6aac32ddb]: (2,) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[598756bc-a208-45dd-90ae-d3d57a8ca211]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:17:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.nvmeof [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 10 19:17:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-2c922039-d41f-4b3d-931e-63e378cef023 req-3e9fb272-8991-4203-ac8a-fc4e21b2433c service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updated VIF entry in instance network info cache for port 4d4b1476-7a64-4370-aa6c-71afdb5ca843. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-2c922039-d41f-4b3d-931e-63e378cef023 req-3e9fb272-8991-4203-ac8a-fc4e21b2433c service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updating instance_info_cache with network_info: [{"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dac2bb-efcd-4b32-be65-c932e07f357d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2c922039-d41f-4b3d-931e-63e378cef023 req-3e9fb272-8991-4203-ac8a-fc4e21b2433c service nova] Releasing lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e331130-8d62-4e7c-b86b-8e9169d34541]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[31192c5d-8a93-4425-90f6-3777b24e3a3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:17:43 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:17:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ed7d65-9de6-43b4-a610-b53e60ca55b3]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG os_brick.utils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] <== get_connector_properties: return (1937ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:17:43 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updating existing volume attachment record: 1605e539-c6e3-48cd-88c4-06e468ae886f {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-98396191-80f7-41b7-8ab3-0bcaa7673aab req-a94ed55b-ecf5-4411-89ef-e768167c4f68 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received event network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-98396191-80f7-41b7-8ab3-0bcaa7673aab req-a94ed55b-ecf5-4411-89ef-e768167c4f68 service nova] Acquiring lock "e83d61e5-b030-4353-9355-d83875c3be36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-98396191-80f7-41b7-8ab3-0bcaa7673aab req-a94ed55b-ecf5-4411-89ef-e768167c4f68 service nova] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-98396191-80f7-41b7-8ab3-0bcaa7673aab req-a94ed55b-ecf5-4411-89ef-e768167c4f68 service nova] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-98396191-80f7-41b7-8ab3-0bcaa7673aab req-a94ed55b-ecf5-4411-89ef-e768167c4f68 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] No waiting events found dispatching network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:17:44 user nova-compute[75026]: WARNING nova.compute.manager [req-98396191-80f7-41b7-8ab3-0bcaa7673aab req-a94ed55b-ecf5-4411-89ef-e768167c4f68 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received unexpected event network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a for instance with vm_state building and task_state spawning.
Nov 10 19:17:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:17:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Instance spawned successfully.
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:17:46 user nova-compute[75026]: INFO nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-8aa8b86c-fd48-47d5-b472-88e76c3c3cde req-ff01da7d-8764-4e9c-a943-7824533ce1a9 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received event network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8aa8b86c-fd48-47d5-b472-88e76c3c3cde req-ff01da7d-8764-4e9c-a943-7824533ce1a9 service nova] Acquiring lock "e83d61e5-b030-4353-9355-d83875c3be36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8aa8b86c-fd48-47d5-b472-88e76c3c3cde req-ff01da7d-8764-4e9c-a943-7824533ce1a9 service nova] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8aa8b86c-fd48-47d5-b472-88e76c3c3cde req-ff01da7d-8764-4e9c-a943-7824533ce1a9 service nova] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-8aa8b86c-fd48-47d5-b472-88e76c3c3cde req-ff01da7d-8764-4e9c-a943-7824533ce1a9 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] No waiting events found dispatching network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:17:46 user nova-compute[75026]: WARNING nova.compute.manager [req-8aa8b86c-fd48-47d5-b472-88e76c3c3cde req-ff01da7d-8764-4e9c-a943-7824533ce1a9 service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received unexpected event network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a for instance with vm_state building and task_state spawning.
Nov 10 19:17:46 user nova-compute[75026]: INFO nova.compute.manager [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Took 6.98 seconds to build instance.
Nov 10 19:17:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6b843440-6cf5-4896-9502-90ce534d5f8c tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "e83d61e5-b030-4353-9355-d83875c3be36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.159s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:17:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-5bda250c-6564-4bdb-9ada-36eb4c56cbd5 req-b55719e7-3a30-4ed2-95ef-fc460eb6ad80 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-changed-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-5bda250c-6564-4bdb-9ada-36eb4c56cbd5 req-b55719e7-3a30-4ed2-95ef-fc460eb6ad80 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Refreshing instance network info cache due to event network-changed-acc7927d-7433-4d3b-a371-9b1433e46ee1. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5bda250c-6564-4bdb-9ada-36eb4c56cbd5 req-b55719e7-3a30-4ed2-95ef-fc460eb6ad80 service nova] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5bda250c-6564-4bdb-9ada-36eb4c56cbd5 req-b55719e7-3a30-4ed2-95ef-fc460eb6ad80 service nova] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG nova.network.neutron [req-5bda250c-6564-4bdb-9ada-36eb4c56cbd5 req-b55719e7-3a30-4ed2-95ef-fc460eb6ad80 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Refreshing network info cache for port acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG nova.network.neutron [req-5bda250c-6564-4bdb-9ada-36eb4c56cbd5 req-b55719e7-3a30-4ed2-95ef-fc460eb6ad80 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updated VIF entry in instance network info cache for port acc7927d-7433-4d3b-a371-9b1433e46ee1. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:17:59 user nova-compute[75026]: DEBUG nova.network.neutron [req-5bda250c-6564-4bdb-9ada-36eb4c56cbd5 req-b55719e7-3a30-4ed2-95ef-fc460eb6ad80 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5bda250c-6564-4bdb-9ada-36eb4c56cbd5 req-b55719e7-3a30-4ed2-95ef-fc460eb6ad80 service nova] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:18:00 user nova-compute[75026]: INFO nova.compute.claims [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Claim successful on node user
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:18:00 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.policy [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8448d842ea1f478392fbdb0c27afed56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d16cff5b9b94e95b61b63e8ffd25066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:18:00 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Creating image(s)
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "/opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "/opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "/opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:00 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.216s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.210s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk 1073741824" returned: 0 in 0.057s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.235s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Successfully created port: c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Cannot resize image /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Ensure instance console log exists: /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Successfully updated port: c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "refresh_cache-a015e0b7-7ebd-407a-9bb5-697a0e5b8365" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquired lock "refresh_cache-a015e0b7-7ebd-407a-9bb5-697a0e5b8365" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-ff6c93d8-f5e4-4ab9-815e-ca24fdaa6f79 req-d25a5dd9-2d4e-4ec4-b828-e74f2e1bebff service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received event network-changed-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-ff6c93d8-f5e4-4ab9-815e-ca24fdaa6f79 req-d25a5dd9-2d4e-4ec4-b828-e74f2e1bebff service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Refreshing instance network info cache due to event network-changed-c88405f0-cfb1-4354-b3b0-d60c8e19867d. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ff6c93d8-f5e4-4ab9-815e-ca24fdaa6f79 req-d25a5dd9-2d4e-4ec4-b828-e74f2e1bebff service nova] Acquiring lock "refresh_cache-a015e0b7-7ebd-407a-9bb5-697a0e5b8365" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Updating instance_info_cache with network_info: [{"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Releasing lock "refresh_cache-a015e0b7-7ebd-407a-9bb5-697a0e5b8365" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Instance network_info: |[{"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ff6c93d8-f5e4-4ab9-815e-ca24fdaa6f79 req-d25a5dd9-2d4e-4ec4-b828-e74f2e1bebff service nova] Acquired lock "refresh_cache-a015e0b7-7ebd-407a-9bb5-697a0e5b8365" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.neutron [req-ff6c93d8-f5e4-4ab9-815e-ca24fdaa6f79 req-d25a5dd9-2d4e-4ec4-b828-e74f2e1bebff service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Refreshing network info cache for port c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Start _get_guest_xml network_info=[{"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:18:02 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:18:02 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1336349962',display_name='tempest-ServersNegativeTestJSON-server-1336349962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1336349962',id=11,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d16cff5b9b94e95b61b63e8ffd25066',ramdisk_id='',reservation_id='r-qt4cs8r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-527246051',owner_user_name='tempest-ServersNegativeTestJSON-527246051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:18:01Z,user_data=None,user_id='8448d842ea1f478392fbdb0c27afed56',uuid=a015e0b7-7ebd-407a-9bb5-697a0e5b8365,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converting VIF {"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:71:2f,bridge_name='br-int',has_traffic_filtering=True,id=c88405f0-cfb1-4354-b3b0-d60c8e19867d,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88405f0-cf') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lazy-loading 'pci_devices' on Instance uuid a015e0b7-7ebd-407a-9bb5-697a0e5b8365 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:18:02 user nova-compute[75026]:   <uuid>a015e0b7-7ebd-407a-9bb5-697a0e5b8365</uuid>
Nov 10 19:18:02 user nova-compute[75026]:   <name>instance-0000000b</name>
Nov 10 19:18:02 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:18:02 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:18:02 user nova-compute[75026]:   <metadata>
Nov 10 19:18:02 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:18:02 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:18:02 user nova-compute[75026]:       <nova:name>tempest-ServersNegativeTestJSON-server-1336349962</nova:name>
Nov 10 19:18:02 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:18:02</nova:creationTime>
Nov 10 19:18:02 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:18:02 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:18:02 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:18:02 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:18:02 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:18:02 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:18:02 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:18:02 user nova-compute[75026]:       <nova:owner>
Nov 10 19:18:02 user nova-compute[75026]:         <nova:user uuid="8448d842ea1f478392fbdb0c27afed56">tempest-ServersNegativeTestJSON-527246051-project-member</nova:user>
Nov 10 19:18:02 user nova-compute[75026]:         <nova:project uuid="4d16cff5b9b94e95b61b63e8ffd25066">tempest-ServersNegativeTestJSON-527246051</nova:project>
Nov 10 19:18:02 user nova-compute[75026]:       </nova:owner>
Nov 10 19:18:02 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:18:02 user nova-compute[75026]:       <nova:ports>
Nov 10 19:18:02 user nova-compute[75026]:         <nova:port uuid="c88405f0-cfb1-4354-b3b0-d60c8e19867d">
Nov 10 19:18:02 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:18:02 user nova-compute[75026]:         </nova:port>
Nov 10 19:18:02 user nova-compute[75026]:       </nova:ports>
Nov 10 19:18:02 user nova-compute[75026]:     </nova:instance>
Nov 10 19:18:02 user nova-compute[75026]:   </metadata>
Nov 10 19:18:02 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:18:02 user nova-compute[75026]:     <system>
Nov 10 19:18:02 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:18:02 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:18:02 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:18:02 user nova-compute[75026]:       <entry name="serial">a015e0b7-7ebd-407a-9bb5-697a0e5b8365</entry>
Nov 10 19:18:02 user nova-compute[75026]:       <entry name="uuid">a015e0b7-7ebd-407a-9bb5-697a0e5b8365</entry>
Nov 10 19:18:02 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:18:02 user nova-compute[75026]:     </system>
Nov 10 19:18:02 user nova-compute[75026]:   </sysinfo>
Nov 10 19:18:02 user nova-compute[75026]:   <os>
Nov 10 19:18:02 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:18:02 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:18:02 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:18:02 user nova-compute[75026]:   </os>
Nov 10 19:18:02 user nova-compute[75026]:   <features>
Nov 10 19:18:02 user nova-compute[75026]:     <acpi/>
Nov 10 19:18:02 user nova-compute[75026]:     <apic/>
Nov 10 19:18:02 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:18:02 user nova-compute[75026]:   </features>
Nov 10 19:18:02 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:18:02 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:18:02 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:18:02 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:18:02 user nova-compute[75026]:   </clock>
Nov 10 19:18:02 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:18:02 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:18:02 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:18:02 user nova-compute[75026]:   </cpu>
Nov 10 19:18:02 user nova-compute[75026]:   <devices>
Nov 10 19:18:02 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:18:02 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:18:02 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk"/>
Nov 10 19:18:02 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:18:02 user nova-compute[75026]:     </disk>
Nov 10 19:18:02 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:18:02 user nova-compute[75026]:       <mac address="fa:16:3e:4e:71:2f"/>
Nov 10 19:18:02 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:18:02 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:18:02 user nova-compute[75026]:       <target dev="tapc88405f0-cf"/>
Nov 10 19:18:02 user nova-compute[75026]:     </interface>
Nov 10 19:18:02 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:18:02 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/console.log" append="off"/>
Nov 10 19:18:02 user nova-compute[75026]:     </serial>
Nov 10 19:18:02 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:18:02 user nova-compute[75026]:     <video>
Nov 10 19:18:02 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:18:02 user nova-compute[75026]:     </video>
Nov 10 19:18:02 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:18:02 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:18:02 user nova-compute[75026]:     </rng>
Nov 10 19:18:02 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:18:02 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:18:02 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:18:02 user nova-compute[75026]:     </memballoon>
Nov 10 19:18:02 user nova-compute[75026]:   </devices>
Nov 10 19:18:02 user nova-compute[75026]: </domain>
Nov 10 19:18:02 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1336349962',display_name='tempest-ServersNegativeTestJSON-server-1336349962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1336349962',id=11,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d16cff5b9b94e95b61b63e8ffd25066',ramdisk_id='',reservation_id='r-qt4cs8r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-527246051',owner_user_name='tempest-ServersNegativeTestJSON-527246051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:18:01Z,user_data=None,user_id='8448d842ea1f478392fbdb0c27afed56',uuid=a015e0b7-7ebd-407a-9bb5-697a0e5b8365,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converting VIF {"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:71:2f,bridge_name='br-int',has_traffic_filtering=True,id=c88405f0-cfb1-4354-b3b0-d60c8e19867d,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88405f0-cf') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG os_vif [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:71:2f,bridge_name='br-int',has_traffic_filtering=True,id=c88405f0-cfb1-4354-b3b0-d60c8e19867d,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88405f0-cf') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca18446f-3dda-5bac-8c0f-39dbdcf3081b', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc88405f0-cf, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc88405f0-cf, col_values=(('qos', UUID('0de4f71e-791d-4053-8863-ec2a78ba6dd8')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc88405f0-cf, col_values=(('external_ids', {'iface-id': 'c88405f0-cfb1-4354-b3b0-d60c8e19867d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:71:2f', 'vm-uuid': 'a015e0b7-7ebd-407a-9bb5-697a0e5b8365'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:18:02 user nova-compute[75026]: INFO os_vif [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:71:2f,bridge_name='br-int',has_traffic_filtering=True,id=c88405f0-cfb1-4354-b3b0-d60c8e19867d,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88405f0-cf')
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.objects.instance [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lazy-loading 'flavor' on Instance uuid 691738e9-227f-4f34-a56e-039c3380f179 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] No VIF found with MAC fa:16:3e:4e:71:2f, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-ff6c93d8-f5e4-4ab9-815e-ca24fdaa6f79 req-d25a5dd9-2d4e-4ec4-b828-e74f2e1bebff service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Updated VIF entry in instance network info cache for port c88405f0-cfb1-4354-b3b0-d60c8e19867d. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-ff6c93d8-f5e4-4ab9-815e-ca24fdaa6f79 req-d25a5dd9-2d4e-4ec4-b828-e74f2e1bebff service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Updating instance_info_cache with network_info: [{"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ff6c93d8-f5e4-4ab9-815e-ca24fdaa6f79 req-d25a5dd9-2d4e-4ec4-b828-e74f2e1bebff service nova] Releasing lock "refresh_cache-a015e0b7-7ebd-407a-9bb5-697a0e5b8365" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:03 user nova-compute[75026]: INFO nova.compute.manager [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Attaching volume 51053e6b-3079-4e7b-9111-87409566c204 to /dev/vdb
Nov 10 19:18:03 user nova-compute[75026]: DEBUG os_brick.utils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d483478d-87eb-4aaf-8662-e1c673c9543c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4642709-ccf5-43ad-ad9c-faf6360bf3a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[465133bc-af04-4088-af8e-40b4a5d300f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a90de9-1853-4190-8005-c279f531e1aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:03 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e4516-b1a8-4f13-bf2a-fc18f17763cb]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG os_brick.utils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Updating existing volume attachment record: f54c4066-6e4e-49b6-bc89-2fcaeb1378a7 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-e610eeff-0276-4ed6-8113-e2812348ee24 req-71394455-404f-4d75-bf47-792387a9eee1 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received event network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e610eeff-0276-4ed6-8113-e2812348ee24 req-71394455-404f-4d75-bf47-792387a9eee1 service nova] Acquiring lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e610eeff-0276-4ed6-8113-e2812348ee24 req-71394455-404f-4d75-bf47-792387a9eee1 service nova] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e610eeff-0276-4ed6-8113-e2812348ee24 req-71394455-404f-4d75-bf47-792387a9eee1 service nova] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-e610eeff-0276-4ed6-8113-e2812348ee24 req-71394455-404f-4d75-bf47-792387a9eee1 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] No waiting events found dispatching network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:18:04 user nova-compute[75026]: WARNING nova.compute.manager [req-e610eeff-0276-4ed6-8113-e2812348ee24 req-71394455-404f-4d75-bf47-792387a9eee1 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received unexpected event network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d for instance with vm_state building and task_state spawning.
Nov 10 19:18:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-c431859e-6c53-466d-b5c5-8eada31412ec req-b5bfd827-e04e-4a97-9279-31411d4dba91 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received event network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c431859e-6c53-466d-b5c5-8eada31412ec req-b5bfd827-e04e-4a97-9279-31411d4dba91 service nova] Acquiring lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c431859e-6c53-466d-b5c5-8eada31412ec req-b5bfd827-e04e-4a97-9279-31411d4dba91 service nova] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c431859e-6c53-466d-b5c5-8eada31412ec req-b5bfd827-e04e-4a97-9279-31411d4dba91 service nova] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-c431859e-6c53-466d-b5c5-8eada31412ec req-b5bfd827-e04e-4a97-9279-31411d4dba91 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] No waiting events found dispatching network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:18:07 user nova-compute[75026]: WARNING nova.compute.manager [req-c431859e-6c53-466d-b5c5-8eada31412ec req-b5bfd827-e04e-4a97-9279-31411d4dba91 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received unexpected event network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d for instance with vm_state building and task_state spawning.
Nov 10 19:18:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:18:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7287MB free_disk=25.640357971191406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Instance spawned successfully.
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:07 user nova-compute[75026]: INFO nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 691738e9-227f-4f34-a56e-039c3380f179 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 766b49e2-52e5-4184-a870-0aa4e53f38ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance d57c5ada-750c-41af-a14c-6546374cf5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 09a67456-da2f-4478-8c9a-6cac0e505134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4fc47635-99d4-47a8-a482-022d75931831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e83d61e5-b030-4353-9355-d83875c3be36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance a015e0b7-7ebd-407a-9bb5-697a0e5b8365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:18:07 user nova-compute[75026]: INFO nova.compute.manager [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Took 7.54 seconds to build instance.
Nov 10 19:18:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d210ee7c-a153-4042-a09e-0f8537848b0f tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.676s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:18:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:18:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:18:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:18:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:18:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:18:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:18:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-bfe6d36d-a907-43ee-8201-b4ebb992b241 req-b7ba27e7-0cb9-4b24-9819-7cf5b21a499d service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-changed-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-bfe6d36d-a907-43ee-8201-b4ebb992b241 req-b7ba27e7-0cb9-4b24-9819-7cf5b21a499d service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Refreshing instance network info cache due to event network-changed-1204de9a-a15a-41b6-90d3-b475a3fc9561. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:18:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfe6d36d-a907-43ee-8201-b4ebb992b241 req-b7ba27e7-0cb9-4b24-9819-7cf5b21a499d service nova] Acquiring lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfe6d36d-a907-43ee-8201-b4ebb992b241 req-b7ba27e7-0cb9-4b24-9819-7cf5b21a499d service nova] Acquired lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfe6d36d-a907-43ee-8201-b4ebb992b241 req-b7ba27e7-0cb9-4b24-9819-7cf5b21a499d service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Refreshing network info cache for port 1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:18:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfe6d36d-a907-43ee-8201-b4ebb992b241 req-b7ba27e7-0cb9-4b24-9819-7cf5b21a499d service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Updated VIF entry in instance network info cache for port 1204de9a-a15a-41b6-90d3-b475a3fc9561. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:18:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfe6d36d-a907-43ee-8201-b4ebb992b241 req-b7ba27e7-0cb9-4b24-9819-7cf5b21a499d service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Updating instance_info_cache with network_info: [{"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfe6d36d-a907-43ee-8201-b4ebb992b241 req-b7ba27e7-0cb9-4b24-9819-7cf5b21a499d service nova] Releasing lock "refresh_cache-766b49e2-52e5-4184-a870-0aa4e53f38ea" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG nova.objects.instance [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lazy-loading 'flavor' on Instance uuid 766b49e2-52e5-4184-a870-0aa4e53f38ea {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:23 user nova-compute[75026]: INFO nova.compute.manager [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Attaching volume 4f1efade-df21-4868-a43d-93a988f3b6d8 to /dev/sdc
Nov 10 19:18:23 user nova-compute[75026]: DEBUG os_brick.utils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e690effb-2c51-40b4-9b69-2f4c697e850a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb5337e-30c0-4753-b09b-3cb00c2430d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d32889-29c8-4613-b640-ac060c7a36e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e033c950-6b4b-4675-95b6-eb841a3c455f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:24 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:18:24 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ec0127-a46b-45b3-9b72-03ab310440dd]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG os_brick.utils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:24 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Updating existing volume attachment record: 97ad6099-4577-4a70-82ad-5465f24e376e {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:18:25 user nova-compute[75026]: DEBUG nova.compute.manager [req-fbef8faf-4c17-4c15-929e-6844058ab9b3 req-3a07d3b1-6605-4285-a195-1e2ef18a87f6 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received event network-changed-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:25 user nova-compute[75026]: DEBUG nova.compute.manager [req-fbef8faf-4c17-4c15-929e-6844058ab9b3 req-3a07d3b1-6605-4285-a195-1e2ef18a87f6 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Refreshing instance network info cache due to event network-changed-f8c478bb-de4d-494b-bfff-497255329d99. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:18:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fbef8faf-4c17-4c15-929e-6844058ab9b3 req-3a07d3b1-6605-4285-a195-1e2ef18a87f6 service nova] Acquiring lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fbef8faf-4c17-4c15-929e-6844058ab9b3 req-3a07d3b1-6605-4285-a195-1e2ef18a87f6 service nova] Acquired lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:25 user nova-compute[75026]: DEBUG nova.network.neutron [req-fbef8faf-4c17-4c15-929e-6844058ab9b3 req-3a07d3b1-6605-4285-a195-1e2ef18a87f6 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Refreshing network info cache for port f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:18:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-fbef8faf-4c17-4c15-929e-6844058ab9b3 req-3a07d3b1-6605-4285-a195-1e2ef18a87f6 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updated VIF entry in instance network info cache for port f8c478bb-de4d-494b-bfff-497255329d99. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:18:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-fbef8faf-4c17-4c15-929e-6844058ab9b3 req-3a07d3b1-6605-4285-a195-1e2ef18a87f6 service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updating instance_info_cache with network_info: [{"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fbef8faf-4c17-4c15-929e-6844058ab9b3 req-3a07d3b1-6605-4285-a195-1e2ef18a87f6 service nova] Releasing lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connector [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Factory for ISCSI on None {{(pid=75026) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbjlnyCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:30 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:18:30 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:18:30 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[95074931-0acb-4c99-9ef0-04cce3f39b21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:18:30 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a5f3cb-1b73-45f3-80f0-d479e969529a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204] added
Nov 10 19:18:30 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd3124-1b80-4c0b-be96-f116cfa7600e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6c0624-02bf-42e1-b0d6-3f47776f6dc0]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbjlnyCx {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbjlnyCx" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc5e94-9089-4409-81ef-8b6ecbf47678]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbjlnyCx'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e601d4-7d8a-45fe-b9fd-d106eb404311]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0747b7d-ff76-4ffd-a97c-318575f3a63d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:18:30 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:18:30 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:18:30 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:18:30 user nova-compute[75026]: 
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[113f577a-61e4-42b6-8a15-42cb76f91577]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204, portal: 172.16.0.220,3260]
Nov 10 19:18:30 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204, portal: 172.16.0.220,3260] successful.
Nov 10 19:18:30 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac58051b-432f-4ed5-82be-4b533e8979e3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2194ed47-4ebb-4885-a94e-13f42179576c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)
Nov 10 19:18:30 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)
Nov 10 19:18:30 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c2dbf8-2dca-4127-b24c-08160f5e11d8]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:18:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbjlnyCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:18:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:18:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23834326231393761', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834326231393761', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:18:31 user nova-compute[75026]: DEBUG nova.objects.instance [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lazy-loading 'flavor' on Instance uuid 691738e9-227f-4f34-a56e-039c3380f179 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:18:31 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:18:31 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:18:31 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:18:31 user nova-compute[75026]:   <serial>51053e6b-3079-4e7b-9111-87409566c204</serial>
Nov 10 19:18:31 user nova-compute[75026]: </disk>
Nov 10 19:18:31 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] No VIF found with MAC fa:16:3e:8c:33:86, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7c7c2b23-db78-4a24-8a73-1d9981784850 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.962s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:32 user nova-compute[75026]: INFO nova.compute.manager [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Terminating instance
Nov 10 19:18:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-2d5e7ae1-882c-4bf1-aabb-e5e8d52deca1 req-ddf49953-7234-4fda-a5e8-5178211b60c8 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received event network-vif-unplugged-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2d5e7ae1-882c-4bf1-aabb-e5e8d52deca1 req-ddf49953-7234-4fda-a5e8-5178211b60c8 service nova] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2d5e7ae1-882c-4bf1-aabb-e5e8d52deca1 req-ddf49953-7234-4fda-a5e8-5178211b60c8 service nova] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2d5e7ae1-882c-4bf1-aabb-e5e8d52deca1 req-ddf49953-7234-4fda-a5e8-5178211b60c8 service nova] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-2d5e7ae1-882c-4bf1-aabb-e5e8d52deca1 req-ddf49953-7234-4fda-a5e8-5178211b60c8 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] No waiting events found dispatching network-vif-unplugged-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-2d5e7ae1-882c-4bf1-aabb-e5e8d52deca1 req-ddf49953-7234-4fda-a5e8-5178211b60c8 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received event network-vif-unplugged-20276b2d-b468-4438-8434-648d3ca04e9c for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:18:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Creating image(s)
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Ensure instance console log exists: /opt/stack/data/nova/instances/0c42552f-3882-4f34-bf6a-fdef6a69e785/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Start _get_guest_xml network_info=[{"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '1605e539-c6e3-48cd-88c4-06e468ae886f', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUfquvom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c42552f-3882-4f34-bf6a-fdef6a69e785', 'attached_at': '', 'detached_at': '', 'volume_id': '277e5d4b-3d2c-487d-9525-c2152138cb88', 'serial': '277e5d4b-3d2c-487d-9525-c2152138cb88'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:18:33 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:18:33 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUfquvom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:33 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:18:33 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:18:33 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd07e43b-626a-4e40-8628-3c516df17d7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:18:33 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5448ec4d-4d9f-4bf2-bc87-869051ea4017]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88] added
Nov 10 19:18:33 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b3ae8-48f6-49e0-9ca0-ccb6ea4b56fa]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[03538063-b5af-4c8e-a759-a49b247f721e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUfquvom {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Instance destroyed successfully.
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.objects.instance [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lazy-loading 'resources' on Instance uuid 691738e9-227f-4f34-a56e-039c3380f179 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUfquvom" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cad42ee-db89-410d-bb54-4ad4ffe388c7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUfquvom'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-781441838',display_name='tempest-DeleteServersTestJSON-server-781441838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-781441838',id=1,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0165786339c0416ab29163bea0f79c81',ramdisk_id='',reservation_id='r-ncng8l0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1223626386',owner_user_name='tempest-DeleteServersTestJSON-1223626386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:16:24Z,user_data=None,user_id='f56fae1310544d9a8afb8f557d52b621',uuid=691738e9-227f-4f34-a56e-039c3380f179,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Converting VIF {"id": "20276b2d-b468-4438-8434-648d3ca04e9c", "address": "fa:16:3e:8c:33:86", "network": {"id": "b7e221fd-bce7-4761-a4ef-7435e306d966", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1857580653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0165786339c0416ab29163bea0f79c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20276b2d-b4", "ovs_interfaceid": "20276b2d-b468-4438-8434-648d3ca04e9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:33:86,bridge_name='br-int',has_traffic_filtering=True,id=20276b2d-b468-4438-8434-648d3ca04e9c,network=Network(b7e221fd-bce7-4761-a4ef-7435e306d966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20276b2d-b4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_vif [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:33:86,bridge_name='br-int',has_traffic_filtering=True,id=20276b2d-b468-4438-8434-648d3ca04e9c,network=Network(b7e221fd-bce7-4761-a4ef-7435e306d966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20276b2d-b4') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35937eef-6da4-4e2f-9d59-d626c9372026]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20276b2d-b4, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=065daea2-3047-4356-8148-3e79f0c21394) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:33 user nova-compute[75026]: INFO os_vif [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:33:86,bridge_name='br-int',has_traffic_filtering=True,id=20276b2d-b468-4438-8434-648d3ca04e9c,network=Network(b7e221fd-bce7-4761-a4ef-7435e306d966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20276b2d-b4')
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b5c52-748f-4a55-860c-9a37d01a872e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)
Nov 10 19:18:33 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)
Nov 10 19:18:33 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbjlnyCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:33 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc704f6a-f339-4300-a06b-ac8381576f1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88, portal: 172.16.0.220,3260]
Nov 10 19:18:33 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88, portal: 172.16.0.220,3260] successful.
Nov 10 19:18:33 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a973d7c-5798-4e87-9954-ceac4c971bfe]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da1946b-9eeb-4076-aff2-700cb3e4d175]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)
Nov 10 19:18:34 user nova-compute[75026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:18:34 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)
Nov 10 19:18:34 user nova-compute[75026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:18:34 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b49caea-3bff-463e-a583-657d8404ebd0]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:18:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUfquvom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23433366233613262', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433366233613262', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.148s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef11c6f-6989-4074-ba78-4fb3861bbc27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:18:35 user nova-compute[75026]: No targets found.
Nov 10 19:18:35 user nova-compute[75026]: iSNS:
Nov 10 19:18:35 user nova-compute[75026]: No targets found.
Nov 10 19:18:35 user nova-compute[75026]: STATIC:
Nov 10 19:18:35 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204
Nov 10 19:18:35 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:18:35 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:18:35 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88
Nov 10 19:18:35 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:18:35 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:18:35 user nova-compute[75026]: FIRMWARE:
Nov 10 19:18:35 user nova-compute[75026]: No targets found.
Nov 10 19:18:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:18:35 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:18:35 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-162507539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-162507539',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRD8myHOfIhviu7LfFnBihpO63lRGsWq1HpX5chid9pgfh39F9om3fOpUOeK796Dxjla897sHiGYLDgEOk7pyFgQBoCBBrE5hhw1iV8IbOeo2vVmNrw0cMSi8cUNDQ1OA==',key_name='tempest-keypair-528756599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c4d825c26084145af53ad27bb9ebcec',ramdisk_id='',reservation_id='r-g0r0xvj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2124583126',owner_user_name='tempest-ServerActionsV293TestJSON-2124583126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e249c4693e7f4301b7ee850a0a2a3e45',uuid=0c42552f-3882-4f34-bf6a-fdef6a69e785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Converting VIF {"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.objects.instance [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c42552f-3882-4f34-bf6a-fdef6a69e785 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:18:35 user nova-compute[75026]:   <uuid>0c42552f-3882-4f34-bf6a-fdef6a69e785</uuid>
Nov 10 19:18:35 user nova-compute[75026]:   <name>instance-0000000a</name>
Nov 10 19:18:35 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:18:35 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:18:35 user nova-compute[75026]:   <metadata>
Nov 10 19:18:35 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:18:35 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:18:35 user nova-compute[75026]:       <nova:name>tempest-ServerActionsV293TestJSON-server-162507539</nova:name>
Nov 10 19:18:35 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:18:33</nova:creationTime>
Nov 10 19:18:35 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:18:35 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:18:35 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:18:35 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:18:35 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:18:35 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:18:35 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:18:35 user nova-compute[75026]:       <nova:owner>
Nov 10 19:18:35 user nova-compute[75026]:         <nova:user uuid="e249c4693e7f4301b7ee850a0a2a3e45">tempest-ServerActionsV293TestJSON-2124583126-project-member</nova:user>
Nov 10 19:18:35 user nova-compute[75026]:         <nova:project uuid="9c4d825c26084145af53ad27bb9ebcec">tempest-ServerActionsV293TestJSON-2124583126</nova:project>
Nov 10 19:18:35 user nova-compute[75026]:       </nova:owner>
Nov 10 19:18:35 user nova-compute[75026]:       <nova:ports>
Nov 10 19:18:35 user nova-compute[75026]:         <nova:port uuid="4d4b1476-7a64-4370-aa6c-71afdb5ca843">
Nov 10 19:18:35 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 19:18:35 user nova-compute[75026]:         </nova:port>
Nov 10 19:18:35 user nova-compute[75026]:       </nova:ports>
Nov 10 19:18:35 user nova-compute[75026]:     </nova:instance>
Nov 10 19:18:35 user nova-compute[75026]:   </metadata>
Nov 10 19:18:35 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:18:35 user nova-compute[75026]:     <system>
Nov 10 19:18:35 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:18:35 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:18:35 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:18:35 user nova-compute[75026]:       <entry name="serial">0c42552f-3882-4f34-bf6a-fdef6a69e785</entry>
Nov 10 19:18:35 user nova-compute[75026]:       <entry name="uuid">0c42552f-3882-4f34-bf6a-fdef6a69e785</entry>
Nov 10 19:18:35 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:18:35 user nova-compute[75026]:     </system>
Nov 10 19:18:35 user nova-compute[75026]:   </sysinfo>
Nov 10 19:18:35 user nova-compute[75026]:   <os>
Nov 10 19:18:35 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:18:35 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:18:35 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:18:35 user nova-compute[75026]:   </os>
Nov 10 19:18:35 user nova-compute[75026]:   <features>
Nov 10 19:18:35 user nova-compute[75026]:     <acpi/>
Nov 10 19:18:35 user nova-compute[75026]:     <apic/>
Nov 10 19:18:35 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:18:35 user nova-compute[75026]:   </features>
Nov 10 19:18:35 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:18:35 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:18:35 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:18:35 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:18:35 user nova-compute[75026]:   </clock>
Nov 10 19:18:35 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:18:35 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:18:35 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:18:35 user nova-compute[75026]:   </cpu>
Nov 10 19:18:35 user nova-compute[75026]:   <devices>
Nov 10 19:18:35 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:18:35 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:18:35 user nova-compute[75026]:       <source dev="/dev/sdc"/>
Nov 10 19:18:35 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:18:35 user nova-compute[75026]:       <serial>277e5d4b-3d2c-487d-9525-c2152138cb88</serial>
Nov 10 19:18:35 user nova-compute[75026]:     </disk>
Nov 10 19:18:35 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:18:35 user nova-compute[75026]:       <mac address="fa:16:3e:0a:db:aa"/>
Nov 10 19:18:35 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:18:35 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:18:35 user nova-compute[75026]:       <target dev="tap4d4b1476-7a"/>
Nov 10 19:18:35 user nova-compute[75026]:     </interface>
Nov 10 19:18:35 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:18:35 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/0c42552f-3882-4f34-bf6a-fdef6a69e785/console.log" append="off"/>
Nov 10 19:18:35 user nova-compute[75026]:     </serial>
Nov 10 19:18:35 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:18:35 user nova-compute[75026]:     <video>
Nov 10 19:18:35 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:18:35 user nova-compute[75026]:     </video>
Nov 10 19:18:35 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:18:35 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:18:35 user nova-compute[75026]:     </rng>
Nov 10 19:18:35 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:18:35 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:18:35 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:18:35 user nova-compute[75026]:     </memballoon>
Nov 10 19:18:35 user nova-compute[75026]:   </devices>
Nov 10 19:18:35 user nova-compute[75026]: </domain>
Nov 10 19:18:35 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-162507539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-162507539',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRD8myHOfIhviu7LfFnBihpO63lRGsWq1HpX5chid9pgfh39F9om3fOpUOeK796Dxjla897sHiGYLDgEOk7pyFgQBoCBBrE5hhw1iV8IbOeo2vVmNrw0cMSi8cUNDQ1OA==',key_name='tempest-keypair-528756599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c4d825c26084145af53ad27bb9ebcec',ramdisk_id='',reservation_id='r-g0r0xvj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2124583126',owner_user_name='tempest-ServerActionsV293TestJSON-2124583126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e249c4693e7f4301b7ee850a0a2a3e45',uuid=0c42552f-3882-4f34-bf6a-fdef6a69e785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Converting VIF {"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_vif [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f3a93-8ff9-4051-b66f-748b2b52a1d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcc7fcde-bd25-5f07-a65a-b16e3d63ea69', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d4b1476-7a, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d4b1476-7a, col_values=(('qos', UUID('568da4f3-7bef-4d37-86bf-454b37a7f77a')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d4b1476-7a, col_values=(('external_ids', {'iface-id': '4d4b1476-7a64-4370-aa6c-71afdb5ca843', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:db:aa', 'vm-uuid': '0c42552f-3882-4f34-bf6a-fdef6a69e785'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad7cd1-918c-4125-a299-2f1e738310e1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)
Nov 10 19:18:35 user nova-compute[75026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:18:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 (non-flash)
Nov 10 19:18:35 user nova-compute[75026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:18:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed983b9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:35 user nova-compute[75026]: INFO os_vif [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a')
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba45d49f-a695-4acb-a01b-7439014fbd5a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8a9bd3-4615-4969-9d0a-cff4d2bb383a]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] No VIF found with MAC fa:16:3e:0a:db:aa, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d56a08b-6fa3-4a59-91ae-90ef29e0737e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[46409e98-6db2-4551-b544-4c6c289240da]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c5b523-118b-4b6d-a8be-a23593db9a47]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd3bcf-089f-4948-8a4a-786a8fb5566e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204, portal: 172.16.0.220,3260]
Nov 10 19:18:35 user nova-compute[75026]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204, portal: 172.16.0.220,3260] successful.
Nov 10 19:18:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51053e6b-3079-4e7b-9111-87409566c204 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8cfc8a-bef9-4146-bb4b-5eddc7eb6c25]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] <== disconnect_volume: return (1466ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:18:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Deleting instance files /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179_del
Nov 10 19:18:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Deletion of /opt/stack/data/nova/instances/691738e9-227f-4f34-a56e-039c3380f179_del complete
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75026) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 10 19:18:35 user nova-compute[75026]: INFO nova.virt.libvirt.host [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] UEFI support detected
Nov 10 19:18:35 user nova-compute[75026]: INFO nova.compute.manager [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Took 2.51 seconds to destroy the instance on the hypervisor.
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 691738e9-227f-4f34-a56e-039c3380f179] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-e1de1651-f6ba-4dc6-be96-4ce7de9ffc6a req-8734abf7-1613-434f-9fc0-f855440737c1 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received event network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e1de1651-f6ba-4dc6-be96-4ce7de9ffc6a req-8734abf7-1613-434f-9fc0-f855440737c1 service nova] Acquiring lock "691738e9-227f-4f34-a56e-039c3380f179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e1de1651-f6ba-4dc6-be96-4ce7de9ffc6a req-8734abf7-1613-434f-9fc0-f855440737c1 service nova] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e1de1651-f6ba-4dc6-be96-4ce7de9ffc6a req-8734abf7-1613-434f-9fc0-f855440737c1 service nova] Lock "691738e9-227f-4f34-a56e-039c3380f179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-e1de1651-f6ba-4dc6-be96-4ce7de9ffc6a req-8734abf7-1613-434f-9fc0-f855440737c1 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] No waiting events found dispatching network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:18:35 user nova-compute[75026]: WARNING nova.compute.manager [req-e1de1651-f6ba-4dc6-be96-4ce7de9ffc6a req-8734abf7-1613-434f-9fc0-f855440737c1 service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received unexpected event network-vif-plugged-20276b2d-b468-4438-8434-648d3ca04e9c for instance with vm_state active and task_state deleting.
Nov 10 19:18:36 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:36 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Took 0.93 seconds to deallocate network for instance.
Nov 10 19:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-3608b487-20ec-4157-9374-ce9fb10275f7 req-18875ca1-33f6-4ffa-b58e-fb6034f315e9 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received event network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3608b487-20ec-4157-9374-ce9fb10275f7 req-18875ca1-33f6-4ffa-b58e-fb6034f315e9 service nova] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3608b487-20ec-4157-9374-ce9fb10275f7 req-18875ca1-33f6-4ffa-b58e-fb6034f315e9 service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3608b487-20ec-4157-9374-ce9fb10275f7 req-18875ca1-33f6-4ffa-b58e-fb6034f315e9 service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-3608b487-20ec-4157-9374-ce9fb10275f7 req-18875ca1-33f6-4ffa-b58e-fb6034f315e9 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] No waiting events found dispatching network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:18:37 user nova-compute[75026]: WARNING nova.compute.manager [req-3608b487-20ec-4157-9374-ce9fb10275f7 req-18875ca1-33f6-4ffa-b58e-fb6034f315e9 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received unexpected event network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 for instance with vm_state building and task_state spawning.
Nov 10 19:18:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:37 user nova-compute[75026]: INFO nova.compute.manager [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Took 1.16 seconds to detach 1 volumes for instance.
Nov 10 19:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-bfbba9ca-de51-4265-8f6e-318cc34985ad req-025be874-7b48-42c2-b9b9-d40d58266dcd service nova] [instance: 691738e9-227f-4f34-a56e-039c3380f179] Received event network-vif-deleted-20276b2d-b468-4438-8434-648d3ca04e9c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lazy-loading 'flavor' on Instance uuid d57c5ada-750c-41af-a14c-6546374cf5d2 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:38 user nova-compute[75026]: INFO nova.compute.manager [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Attaching volume 4ae43d62-e444-438c-af88-addd14b2fd34 to /dev/vdb
Nov 10 19:18:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG os_brick.utils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dd2fdb-81cc-4cbd-bc98-1f66c4ffa539]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08af767-a959-4a6a-b304-87188d3635e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97f8d1c-b2e2-426c-a952-98c14548a4d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[011819fb-5240-49ec-b9ac-c7ee3ba73648]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:38 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Deleted allocations for instance 691738e9-227f-4f34-a56e-039c3380f179
Nov 10 19:18:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:38 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9222fb4-f3aa-4a0f-9fad-ea8eeb34b15a]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG os_brick.utils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] <== get_connector_properties: return (251ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updating existing volume attachment record: 2d204a0a-238c-4193-b68f-4934f5e0059c {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9fc296cc-778d-4167-bc27-49a372ad4408 tempest-DeleteServersTestJSON-1223626386 tempest-DeleteServersTestJSON-1223626386-project-member] Lock "691738e9-227f-4f34-a56e-039c3380f179" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.701s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG nova.objects.instance [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lazy-loading 'flavor' on Instance uuid 09a67456-da2f-4478-8c9a-6cac0e505134 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:39 user nova-compute[75026]: INFO nova.compute.manager [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Attaching volume dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee to /dev/vdb
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:18:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Instance spawned successfully.
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:18:39 user nova-compute[75026]: INFO nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:18:39 user nova-compute[75026]: INFO nova.compute.manager [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Took 58.69 seconds to build instance.
Nov 10 19:18:39 user nova-compute[75026]: DEBUG os_brick.utils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-414f7392-22c7-4edb-9365-29a9aa81d508 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.853s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d99a85-ceb8-4f0e-9a41-0c143a4ad021]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e578c39-bebf-4ff7-ace3-65f1d76a1fa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[17738625-4f4a-4552-8fae-4ea2a70280d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60668643-3a3a-4a2d-be40-35b783cea2f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received event network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] No waiting events found dispatching network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:18:39 user nova-compute[75026]: WARNING nova.compute.manager [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received unexpected event network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 for instance with vm_state active and task_state None.
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received event network-changed-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Refreshing instance network info cache due to event network-changed-e362b1aa-9251-4e43-b3af-3c825324f644. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] Acquiring lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] Acquired lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.network.neutron [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Refreshing network info cache for port e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:39 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:18:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0163e236-1167-4c71-ba05-5826a77c5a5e]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG os_brick.utils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:39 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Updating existing volume attachment record: 8e37f37e-af50-487f-959c-93807035928c {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:18:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:40 user nova-compute[75026]: DEBUG nova.network.neutron [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Updated VIF entry in instance network info cache for port e362b1aa-9251-4e43-b3af-3c825324f644. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:18:40 user nova-compute[75026]: DEBUG nova.network.neutron [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Updating instance_info_cache with network_info: [{"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d53c084b-8bfc-4c6e-ac07-756bca7bf2d2 req-624f539f-0ef9-476c-b913-0968725962c1 service nova] Releasing lock "refresh_cache-09a67456-da2f-4478-8c9a-6cac0e505134" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-7046ddd5-c717-453e-af09-a4fb2dd755a9 req-69ed0222-a939-4b54-b309-8d401f431589 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-changed-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-7046ddd5-c717-453e-af09-a4fb2dd755a9 req-69ed0222-a939-4b54-b309-8d401f431589 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Refreshing instance network info cache due to event network-changed-8f2f1337-bb4e-4cc0-892d-418b29969d56. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7046ddd5-c717-453e-af09-a4fb2dd755a9 req-69ed0222-a939-4b54-b309-8d401f431589 service nova] Acquiring lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7046ddd5-c717-453e-af09-a4fb2dd755a9 req-69ed0222-a939-4b54-b309-8d401f431589 service nova] Acquired lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-7046ddd5-c717-453e-af09-a4fb2dd755a9 req-69ed0222-a939-4b54-b309-8d401f431589 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Refreshing network info cache for port 8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-7046ddd5-c717-453e-af09-a4fb2dd755a9 req-69ed0222-a939-4b54-b309-8d401f431589 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updated VIF entry in instance network info cache for port 8f2f1337-bb4e-4cc0-892d-418b29969d56. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-7046ddd5-c717-453e-af09-a4fb2dd755a9 req-69ed0222-a939-4b54-b309-8d401f431589 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating instance_info_cache with network_info: [{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7046ddd5-c717-453e-af09-a4fb2dd755a9 req-69ed0222-a939-4b54-b309-8d401f431589 service nova] Releasing lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "interface-4fc47635-99d4-47a8-a482-022d75931831-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "interface-4fc47635-99d4-47a8-a482-022d75931831-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lazy-loading 'flavor' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lazy-loading 'pci_requests' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.objects.base [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Object Instance<4fc47635-99d4-47a8-a482-022d75931831> lazy-loaded attributes: flavor,pci_requests {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:18:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:18:45 user nova-compute[75026]: DEBUG nova.policy [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0eb014a1e2a42ce8f33dcf814421229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dc3afe879d475a96ad9312fec0c3e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:18:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Successfully created port: f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.network.neutron [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Successfully updated port: f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquired lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.network.neutron [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-8a6f902b-6422-45bb-9bf8-4e611ff41f75 req-c376c6d9-e964-493f-8ced-9232fa3f072c service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-changed-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-8a6f902b-6422-45bb-9bf8-4e611ff41f75 req-c376c6d9-e964-493f-8ced-9232fa3f072c service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Refreshing instance network info cache due to event network-changed-f9563120-8021-4e77-9ce5-ab5cf8e39cf0. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a6f902b-6422-45bb-9bf8-4e611ff41f75 req-c376c6d9-e964-493f-8ced-9232fa3f072c service nova] Acquiring lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.network.neutron [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating instance_info_cache with network_info: [{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Releasing lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a6f902b-6422-45bb-9bf8-4e611ff41f75 req-c376c6d9-e964-493f-8ced-9232fa3f072c service nova] Acquired lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.network.neutron [req-8a6f902b-6422-45bb-9bf8-4e611ff41f75 req-c376c6d9-e964-493f-8ced-9232fa3f072c service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Refreshing network info cache for port f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converting VIF {"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG os_vif [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e99bf943-175e-5a5f-a215-362e3a5b0b07', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9563120-80, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9563120-80, col_values=(('qos', UUID('9368aaa4-11b4-40a0-ad93-0ba58e6abb9a')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9563120-80, col_values=(('external_ids', {'iface-id': 'f9563120-8021-4e77-9ce5-ab5cf8e39cf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:50:d4', 'vm-uuid': '4fc47635-99d4-47a8-a482-022d75931831'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:46 user nova-compute[75026]: INFO os_vif [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80')
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converting VIF {"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] attach device xml: <interface type="ethernet">
Nov 10 19:18:46 user nova-compute[75026]:   <mac address="fa:16:3e:86:50:d4"/>
Nov 10 19:18:46 user nova-compute[75026]:   <model type="virtio"/>
Nov 10 19:18:46 user nova-compute[75026]:   <mtu size="1442"/>
Nov 10 19:18:46 user nova-compute[75026]:   <target dev="tapf9563120-80"/>
Nov 10 19:18:46 user nova-compute[75026]: </interface>
Nov 10 19:18:46 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No BDM found with device name hda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No VIF found with MAC fa:16:3e:49:9d:60, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:18:47 user nova-compute[75026]:   <nova:package version="0.0.0"/>
Nov 10 19:18:47 user nova-compute[75026]:   <nova:name>tempest-device-tagging-server-1709409501</nova:name>
Nov 10 19:18:47 user nova-compute[75026]:   <nova:creationTime>2023-11-10 19:18:47</nova:creationTime>
Nov 10 19:18:47 user nova-compute[75026]:   <nova:flavor name="m1.tiny">
Nov 10 19:18:47 user nova-compute[75026]:     <nova:memory>512</nova:memory>
Nov 10 19:18:47 user nova-compute[75026]:     <nova:disk>1</nova:disk>
Nov 10 19:18:47 user nova-compute[75026]:     <nova:swap>0</nova:swap>
Nov 10 19:18:47 user nova-compute[75026]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:18:47 user nova-compute[75026]:     <nova:vcpus>1</nova:vcpus>
Nov 10 19:18:47 user nova-compute[75026]:   </nova:flavor>
Nov 10 19:18:47 user nova-compute[75026]:   <nova:owner>
Nov 10 19:18:47 user nova-compute[75026]:     <nova:user uuid="a0eb014a1e2a42ce8f33dcf814421229">tempest-TaggedAttachmentsTest-617120050-project-member</nova:user>
Nov 10 19:18:47 user nova-compute[75026]:     <nova:project uuid="32dc3afe879d475a96ad9312fec0c3e9">tempest-TaggedAttachmentsTest-617120050</nova:project>
Nov 10 19:18:47 user nova-compute[75026]:   </nova:owner>
Nov 10 19:18:47 user nova-compute[75026]:   <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:18:47 user nova-compute[75026]:   <nova:ports>
Nov 10 19:18:47 user nova-compute[75026]:     <nova:port uuid="8f2f1337-bb4e-4cc0-892d-418b29969d56">
Nov 10 19:18:47 user nova-compute[75026]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:18:47 user nova-compute[75026]:     </nova:port>
Nov 10 19:18:47 user nova-compute[75026]:     <nova:port uuid="f9563120-8021-4e77-9ce5-ab5cf8e39cf0">
Nov 10 19:18:47 user nova-compute[75026]:       <nova:ip type="fixed" address="10.10.10.133" ipVersion="4"/>
Nov 10 19:18:47 user nova-compute[75026]:     </nova:port>
Nov 10 19:18:47 user nova-compute[75026]:   </nova:ports>
Nov 10 19:18:47 user nova-compute[75026]: </nova:instance>
Nov 10 19:18:47 user nova-compute[75026]:  {{(pid=75026) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78c763b5-c58d-44dc-b955-c77de7e5541e tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "interface-4fc47635-99d4-47a8-a482-022d75931831-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.754s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG nova.network.neutron [req-8a6f902b-6422-45bb-9bf8-4e611ff41f75 req-c376c6d9-e964-493f-8ced-9232fa3f072c service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updated VIF entry in instance network info cache for port f9563120-8021-4e77-9ce5-ab5cf8e39cf0. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG nova.network.neutron [req-8a6f902b-6422-45bb-9bf8-4e611ff41f75 req-c376c6d9-e964-493f-8ced-9232fa3f072c service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating instance_info_cache with network_info: [{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a6f902b-6422-45bb-9bf8-4e611ff41f75 req-c376c6d9-e964-493f-8ced-9232fa3f072c service nova] Releasing lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] No waiting events found dispatching network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:18:48 user nova-compute[75026]: WARNING nova.compute.manager [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received unexpected event network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 for instance with vm_state active and task_state None.
Nov 10 19:18:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] No waiting events found dispatching network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:18:48 user nova-compute[75026]: WARNING nova.compute.manager [req-a7aae574-03f7-4ba8-a3e4-d4e3e82757ab req-eac6fa42-2e27-4862-9790-ac52f6a089f3 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received unexpected event network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 for instance with vm_state active and task_state None.
Nov 10 19:18:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlTbNwhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:51 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:18:51 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:18:51 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ca1717-3201-44dd-948a-847294a8b46c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:18:51 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d11d1ca-b921-49de-9b73-5ec718bda7ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8] added
Nov 10 19:18:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[286cf4c7-f921-4b33-b3d9-dc3e3d18876b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f64eb-390c-4b0e-bcb0-79b4840f3f6f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YlTbNwhQ {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YlTbNwhQ" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d259a-15b1-4884-8ef7-cfb9e7bcf860]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YlTbNwhQ'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae6b03-cc6b-43a3-b030-cbcad05a6a26]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f534714-8227-442b-9b2c-d2539db03693]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:18:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:18:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0609c6b-e1b8-414d-b67f-2dfb7b64a53a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8, portal: 172.16.0.220,3260]
Nov 10 19:18:51 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8, portal: 172.16.0.220,3260] successful.
Nov 10 19:18:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1799628-df9e-46b5-a361-42c9705545ab]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6b3d5f-febb-465f-b0ac-1981fd82c15c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:18:51 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:18:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:18:51 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:18:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4818cc-7e81-45ed-b7a3-9ae0956f4340]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlTbNwhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lazy-loading 'flavor' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:18:51 user nova-compute[75026]: INFO nova.compute.manager [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Attaching volume 8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 to /dev/vdb
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.utils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32897160-6924-49cb-ae7f-6440b10a6ffe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1098e8-0901-45fc-9235-f25c4a014b26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f5d260-206a-417a-9c55-30e9e05dc8ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a899fd04-2016-41a0-afe6-c5b7c4b1df7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:18:51 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:18:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a9ee7-f9ca-432d-ba76-80d20e968839]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG os_brick.utils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:51 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating existing volume attachment record: 19315ed5-1dd4-4e52-b30b-55991057028a {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23538383437326633', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538383437326633', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG nova.objects.instance [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lazy-loading 'flavor' on Instance uuid 766b49e2-52e5-4184-a870-0aa4e53f38ea {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:18:52 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:18:52 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:18:52 user nova-compute[75026]:   <target dev="sdc" bus="scsi"/>
Nov 10 19:18:52 user nova-compute[75026]:   <serial>4f1efade-df21-4868-a43d-93a988f3b6d8</serial>
Nov 10 19:18:52 user nova-compute[75026]:   <address type="drive" controller="0" unit="2"/>
Nov 10 19:18:52 user nova-compute[75026]: </disk>
Nov 10 19:18:52 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] No BDM found with device name sda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:18:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] No VIF found with MAC fa:16:3e:d6:81:23, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:18:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:18:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (sdc) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:19:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:19:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:19:06 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.62616729736328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXRuMKpc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:06 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:06 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:06 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 766b49e2-52e5-4184-a870-0aa4e53f38ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance d57c5ada-750c-41af-a14c-6546374cf5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 09a67456-da2f-4478-8c9a-6cac0e505134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4fc47635-99d4-47a8-a482-022d75931831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e83d61e5-b030-4353-9355-d83875c3be36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance a015e0b7-7ebd-407a-9bb5-697a0e5b8365 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[817af3d5-494c-4549-83e2-1e070a08715c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:19:06 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8c8432-d98e-4df5-84c7-3e643130bcf3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee] added
Nov 10 19:19:06 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb9a7d2-2bcf-429e-a506-3f533cc1d372]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0ed0af-2250-407c-b774-13368f1cad8a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXRuMKpc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zXRuMKpc" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6f3732-924c-48ef-84de-874f50fcc5e7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zXRuMKpc'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4646a1fb-10e0-4e1e-9101-70805bf43aee]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c064df70-b2b7-43b2-9f1e-044acfab4490]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:06 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:06 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:06 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:06 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1be5ca-415a-44db-a3eb-20f4e2d7ce20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee, portal: 172.16.0.220,3260]
Nov 10 19:19:06 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee, portal: 172.16.0.220,3260] successful.
Nov 10 19:19:06 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d83ed9-3c02-4123-80f5-270560602f02]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-68e0e418-ff2e-4fad-9341-b3ba017e9f39 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.767s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18370f3-1961-4f89-b202-d901c51d94b8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:06 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:06 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:06 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:06 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:06 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:06 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[860cd08e-ca00-480a-b469-58b9f0c20f60]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXRuMKpc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23336336636646334', 'path': '/dev/sdd'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336336636646334', 'path': '/dev/sdd'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG nova.objects.instance [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lazy-loading 'flavor' on Instance uuid 09a67456-da2f-4478-8c9a-6cac0e505134 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] attach device xml: <disk type="block" device="disk">
Nov 10 19:19:07 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:07 user nova-compute[75026]:   <source dev="/dev/sdd"/>
Nov 10 19:19:07 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:07 user nova-compute[75026]:   <serial>dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee</serial>
Nov 10 19:19:07 user nova-compute[75026]: </disk>
Nov 10 19:19:07 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:19:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:08 user nova-compute[75026]: INFO nova.compute.manager [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Detaching volume 4f1efade-df21-4868-a43d-93a988f3b6d8
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] No VIF found with MAC fa:16:3e:46:08:cd, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updating instance_info_cache with network_info: [{"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:19:08 user nova-compute[75026]: INFO nova.virt.block_device [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Attempting to driver detach volume 4f1efade-df21-4868-a43d-93a988f3b6d8 from mountpoint /dev/sdc
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Attempting to detach device sdc from instance 766b49e2-52e5-4184-a870-0aa4e53f38ea from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:19:08 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:08 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:19:08 user nova-compute[75026]:   <target dev="sdc" bus="scsi"/>
Nov 10 19:19:08 user nova-compute[75026]:   <serial>4f1efade-df21-4868-a43d-93a988f3b6d8</serial>
Nov 10 19:19:08 user nova-compute[75026]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 19:19:08 user nova-compute[75026]: </disk>
Nov 10 19:19:08 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:19:08 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Successfully detached device sdc from instance 766b49e2-52e5-4184-a870-0aa4e53f38ea from the persistent domain config.
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 766b49e2-52e5-4184-a870-0aa4e53f38ea from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:19:08 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:08 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:19:08 user nova-compute[75026]:   <target dev="sdc" bus="scsi"/>
Nov 10 19:19:08 user nova-compute[75026]:   <serial>4f1efade-df21-4868-a43d-93a988f3b6d8</serial>
Nov 10 19:19:08 user nova-compute[75026]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 19:19:08 user nova-compute[75026]: </disk>
Nov 10 19:19:08 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-31d94628-d927-40aa-85d5-b4e0ccf38844 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.148s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 766b49e2-52e5-4184-a870-0aa4e53f38ea {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:19:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0b3133dc-3c24-4fb1-8750-61f5721021c3 tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] volume_snapshot_create: create_info: {'snapshot_id': '7d22123d-b3e2-489c-91c7-f3643237e970', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75026) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 10 19:19:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0b3133dc-3c24-4fb1-8750-61f5721021c3 tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] snap xml: <domainsnapshot>
Nov 10 19:19:09 user nova-compute[75026]:   <disks>
Nov 10 19:19:09 user nova-compute[75026]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 10 19:19:09 user nova-compute[75026]:       <source file="/dev/new_file"/>
Nov 10 19:19:09 user nova-compute[75026]:     </disk>
Nov 10 19:19:09 user nova-compute[75026]:     <disk name="vda" snapshot="no"/>
Nov 10 19:19:09 user nova-compute[75026]:   </disks>
Nov 10 19:19:09 user nova-compute[75026]: </domainsnapshot>
Nov 10 19:19:09 user nova-compute[75026]:  {{(pid=75026) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 10 19:19:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-0b3133dc-3c24-4fb1-8750-61f5721021c3 tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] Lazy-loading 'system_metadata' on Instance uuid 09a67456-da2f-4478-8c9a-6cac0e505134 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:09 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-0b3133dc-3c24-4fb1-8750-61f5721021c3 tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [None req-0b3133dc-3c24-4fb1-8750-61f5721021c3 tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     rv = execute(f, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     six.reraise(c, e, tb)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     raise value
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     rv = meth(*args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [None req-0b3133dc-3c24-4fb1-8750-61f5721021c3 tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     self._volume_snapshot_create(context, instance, guest,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     rv = execute(f, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     six.reraise(c, e, tb)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     raise value
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     rv = meth(*args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] 
Nov 10 19:19:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-303f48fa-3bfa-4d59-bff1-69442913fd1d tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] volume_snapshot_delete: delete_info: {'volume_id': 'dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee'} {{(pid=75026) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [None req-303f48fa-3bfa-4d59-bff1-69442913fd1d tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134]     if delete_info['type'] != 'qcow2':
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] KeyError: 'type'
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [None req-0b3133dc-3c24-4fb1-8750-61f5721021c3 tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 7d22123d-b3e2-489c-91c7-f3643237e970 could not be found.
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     raise value
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 7d22123d-b3e2-489c-91c7-f3643237e970 could not be found. (HTTP 404) (Request-ID: req-8a7c2cb5-9068-4de2-962a-ef8df32a2cec)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 7d22123d-b3e2-489c-91c7-f3643237e970 could not be found.
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server [None req-0b3133dc-3c24-4fb1-8750-61f5721021c3 tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise value
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver [None req-303f48fa-3bfa-4d59-bff1-69442913fd1d tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-17ce6618-4f61-4563-a323-3568390ca849)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 19:19:09 user nova-compute[75026]: ERROR nova.virt.libvirt.driver 
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server [None req-303f48fa-3bfa-4d59-bff1-69442913fd1d tempest-VolumesAssistedSnapshotsTest-141100917 tempest-VolumesAssistedSnapshotsTest-141100917-project] Exception during message handling: KeyError: 'type'
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 10 19:19:09 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:19:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:09 user nova-compute[75026]: INFO nova.compute.manager [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Detaching volume dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee
Nov 10 19:19:09 user nova-compute[75026]: INFO nova.virt.block_device [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Attempting to driver detach volume dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee from mountpoint /dev/vdb
Nov 10 19:19:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Attempting to detach device vdb from instance 09a67456-da2f-4478-8c9a-6cac0e505134 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:19:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 19:19:09 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:09 user nova-compute[75026]:   <source dev="/dev/sdd"/>
Nov 10 19:19:09 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:09 user nova-compute[75026]:   <serial>dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee</serial>
Nov 10 19:19:09 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:19:09 user nova-compute[75026]: </disk>
Nov 10 19:19:09 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:09 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Successfully detached device vdb from instance 09a67456-da2f-4478-8c9a-6cac0e505134 from the persistent domain config.
Nov 10 19:19:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09a67456-da2f-4478-8c9a-6cac0e505134 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:19:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 19:19:09 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:09 user nova-compute[75026]:   <source dev="/dev/sdd"/>
Nov 10 19:19:09 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:09 user nova-compute[75026]:   <serial>dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee</serial>
Nov 10 19:19:09 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:19:09 user nova-compute[75026]: </disk>
Nov 10 19:19:09 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09a67456-da2f-4478-8c9a-6cac0e505134 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:19:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e733c2-baa2-4571-9acc-f97ccf7cbf4b req-30e5bce5-7260-41d5-95a1-5d52220866af service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-changed-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e733c2-baa2-4571-9acc-f97ccf7cbf4b req-30e5bce5-7260-41d5-95a1-5d52220866af service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Refreshing instance network info cache due to event network-changed-090d3b60-38f6-47b6-84e4-1765dac2017e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:19:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e733c2-baa2-4571-9acc-f97ccf7cbf4b req-30e5bce5-7260-41d5-95a1-5d52220866af service nova] Acquiring lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:19:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e733c2-baa2-4571-9acc-f97ccf7cbf4b req-30e5bce5-7260-41d5-95a1-5d52220866af service nova] Acquired lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:19:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-09e733c2-baa2-4571-9acc-f97ccf7cbf4b req-30e5bce5-7260-41d5-95a1-5d52220866af service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Refreshing network info cache for port 090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:19:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG nova.objects.instance [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lazy-loading 'flavor' on Instance uuid 5ca3830d-1edf-4638-a5cf-6cf6efe37362 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-09e733c2-baa2-4571-9acc-f97ccf7cbf4b req-30e5bce5-7260-41d5-95a1-5d52220866af service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Updated VIF entry in instance network info cache for port 090d3b60-38f6-47b6-84e4-1765dac2017e. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-09e733c2-baa2-4571-9acc-f97ccf7cbf4b req-30e5bce5-7260-41d5-95a1-5d52220866af service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Updating instance_info_cache with network_info: [{"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e733c2-baa2-4571-9acc-f97ccf7cbf4b req-30e5bce5-7260-41d5-95a1-5d52220866af service nova] Releasing lock "refresh_cache-5ca3830d-1edf-4638-a5cf-6cf6efe37362" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:15 user nova-compute[75026]: INFO nova.compute.manager [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Attaching volume 1df6ace3-5824-4d80-8bbc-e6802d7d9b90 to /dev/vdb
Nov 10 19:19:15 user nova-compute[75026]: DEBUG os_brick.utils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaf880e-011a-4bea-ae5d-c4aea1c851df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdbf901-0000-4d19-a055-1d8e01ec959c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[708e107a-1657-4dee-b3e6-7191150df0f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d5137f-f634-4780-b7f9-d83896422ffd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:19:15 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:19:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a52943d-c831-45c6-91a4-5134eca31461]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG os_brick.utils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:15 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Updating existing volume attachment record: 5d723758-e273-4b08-930e-cc8d4f7d18ec {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcFbmLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:16 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:16 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:16 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe86c7f4-bf15-489b-8542-25a9e9b1b396]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:19:16 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eb778a-5f13-4fa5-9c28-b65584cd37f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34] added
Nov 10 19:19:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa9c54-e2a8-4455-a466-2f8628e981d4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07a564f-86ee-4b58-90b7-e4850388ca33]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcFbmLJl {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcFbmLJl" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c727e5-8fe1-4b8f-8740-c0f0a0d90788]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DcFbmLJl'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fefb70-3ac9-4444-84e0-5feea3755f7d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f060e8e3-28e4-497a-9401-472994f99bf0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe65397-6093-4a43-8a6a-94f53265b2ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34, portal: 172.16.0.220,3260]
Nov 10 19:19:16 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34, portal: 172.16.0.220,3260] successful.
Nov 10 19:19:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd74281-9ccb-4b78-8f58-b5655115d836]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdd5d90-ac5c-4244-8a1e-a1092bd43e2b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:16 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb35bda4-16fa-4a47-a52c-ee4e7bb3c1ca]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcFbmLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:19:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23232646330633637', 'path': '/dev/sde'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232646330633637', 'path': '/dev/sde'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:19:17 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lazy-loading 'flavor' on Instance uuid d57c5ada-750c-41af-a14c-6546374cf5d2 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:19:17 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:17 user nova-compute[75026]:   <source dev="/dev/sde"/>
Nov 10 19:19:17 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:17 user nova-compute[75026]:   <serial>4ae43d62-e444-438c-af88-addd14b2fd34</serial>
Nov 10 19:19:17 user nova-compute[75026]: </disk>
Nov 10 19:19:17 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] No VIF found with MAC fa:16:3e:eb:7f:d2, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f86f34f2-1013-4516-a2b9-f21aefbc3cb2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.327s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQoBbCkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:18 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac1313-3c1b-4ddf-bba5-b3ebe8cc0806]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:19:18 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e632c7f-ee8f-417a-8ae5-b58f9840ca17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08] added
Nov 10 19:19:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a52a7a-2e4a-45a8-ba51-2e3d78a2f469]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c29b11c-76c0-4092-be75-c0244c812387]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQoBbCkE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQoBbCkE" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c773c-6d38-433e-a9b0-1dfedf0147c7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lQoBbCkE'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39c19c3-e96b-436f-befb-ce8d2215b3e8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f00bae1-3b92-4726-87e9-50cbdc788dd4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd33a0-7b5e-49a6-84ab-29b05338916e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08, portal: 172.16.0.220,3260]
Nov 10 19:19:18 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08, portal: 172.16.0.220,3260] successful.
Nov 10 19:19:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abd9dc4-5c98-4dbf-bac4-79d46666a9a9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8916cc-4cf8-47a8-ba2e-bb34ca4208d1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:19:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52b7637-c27e-4608-aff3-83ac7ab5a324]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:19:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:19 user nova-compute[75026]: INFO nova.compute.manager [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Detaching volume 4ae43d62-e444-438c-af88-addd14b2fd34
Nov 10 19:19:19 user nova-compute[75026]: INFO nova.virt.block_device [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Attempting to driver detach volume 4ae43d62-e444-438c-af88-addd14b2fd34 from mountpoint /dev/vdb
Nov 10 19:19:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Attempting to detach device vdb from instance d57c5ada-750c-41af-a14c-6546374cf5d2 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:19:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:19:19 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:19 user nova-compute[75026]:   <source dev="/dev/sde"/>
Nov 10 19:19:19 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:19 user nova-compute[75026]:   <serial>4ae43d62-e444-438c-af88-addd14b2fd34</serial>
Nov 10 19:19:19 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:19:19 user nova-compute[75026]: </disk>
Nov 10 19:19:19 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:19 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Successfully detached device vdb from instance d57c5ada-750c-41af-a14c-6546374cf5d2 from the persistent domain config.
Nov 10 19:19:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d57c5ada-750c-41af-a14c-6546374cf5d2 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:19:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:19:19 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:19 user nova-compute[75026]:   <source dev="/dev/sde"/>
Nov 10 19:19:19 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:19 user nova-compute[75026]:   <serial>4ae43d62-e444-438c-af88-addd14b2fd34</serial>
Nov 10 19:19:19 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:19:19 user nova-compute[75026]: </disk>
Nov 10 19:19:19 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQoBbCkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26539356333306233', 'path': '/dev/sdf'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539356333306233', 'path': '/dev/sdf'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lazy-loading 'flavor' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:19:20 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:20 user nova-compute[75026]:   <source dev="/dev/sdf"/>
Nov 10 19:19:20 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:20 user nova-compute[75026]:   <serial>8f3ca0ba-1710-49f9-9243-60f4e4c9cf08</serial>
Nov 10 19:19:20 user nova-compute[75026]: </disk>
Nov 10 19:19:20 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d57c5ada-750c-41af-a14c-6546374cf5d2 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No BDM found with device name hda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] No VIF found with MAC fa:16:3e:49:9d:60, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:19:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cf5721e3-cac9-4377-b577-eceba49ab82a tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.929s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:21 user nova-compute[75026]: INFO nova.compute.manager [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Detaching volume 8f3ca0ba-1710-49f9-9243-60f4e4c9cf08
Nov 10 19:19:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:21 user nova-compute[75026]: INFO nova.virt.block_device [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Attempting to driver detach volume 8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 from mountpoint /dev/vdb
Nov 10 19:19:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Attempting to detach device vdb from instance 4fc47635-99d4-47a8-a482-022d75931831 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:19:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:19:21 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:21 user nova-compute[75026]:   <source dev="/dev/sdf"/>
Nov 10 19:19:21 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:21 user nova-compute[75026]:   <serial>8f3ca0ba-1710-49f9-9243-60f4e4c9cf08</serial>
Nov 10 19:19:21 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 19:19:21 user nova-compute[75026]: </disk>
Nov 10 19:19:21 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Successfully detached device vdb from instance 4fc47635-99d4-47a8-a482-022d75931831 from the persistent domain config.
Nov 10 19:19:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fc47635-99d4-47a8-a482-022d75931831 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:19:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:19:21 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:21 user nova-compute[75026]:   <source dev="/dev/sdf"/>
Nov 10 19:19:21 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:21 user nova-compute[75026]:   <serial>8f3ca0ba-1710-49f9-9243-60f4e4c9cf08</serial>
Nov 10 19:19:21 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 19:19:21 user nova-compute[75026]: </disk>
Nov 10 19:19:21 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:22 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:19:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:28 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 766b49e2-52e5-4184-a870-0aa4e53f38ea is timed out.
Nov 10 19:19:28 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Successfully detached device sdc from instance 766b49e2-52e5-4184-a870-0aa4e53f38ea from the live domain config.
Nov 10 19:19:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlTbNwhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:28 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c66355-bfd0-40ad-917a-11597328dd9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:19:28 user nova-compute[75026]: No targets found.
Nov 10 19:19:28 user nova-compute[75026]: iSNS:
Nov 10 19:19:28 user nova-compute[75026]: No targets found.
Nov 10 19:19:28 user nova-compute[75026]: STATIC:
Nov 10 19:19:28 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34
Nov 10 19:19:28 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:28 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:28 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08
Nov 10 19:19:28 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:28 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:28 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88
Nov 10 19:19:28 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:28 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:28 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8
Nov 10 19:19:28 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:28 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:28 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee
Nov 10 19:19:28 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:28 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:28 user nova-compute[75026]: FIRMWARE:
Nov 10 19:19:28 user nova-compute[75026]: No targets found.
Nov 10 19:19:28 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:19:28 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:19:28 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64c22df-e253-429e-9713-29bf7a0744fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d240c9c2-58c3-485d-82b9-ed652a612639]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:28 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:28 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:28 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:28 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:28 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:28 user nova-compute[75026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 (non-flash)
Nov 10 19:19:28 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:28 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:28 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:28 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda01af370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d427e0a0-ac8e-4258-9d5c-3c30de5e1fe9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc03cfb-1640-44cb-88fe-9f428058e7de]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7166a73-edb5-499c-86a6-ac1e6f0b5621]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff11ff4-f966-43ee-b545-c499fb044640]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e74f8-8110-467e-a005-2e40cba0a169]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a63a69d-c8da-42f1-a73f-fe4ef155a3ec]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8, portal: 172.16.0.220,3260]
Nov 10 19:19:29 user nova-compute[75026]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8, portal: 172.16.0.220,3260] successful.
Nov 10 19:19:29 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1efade-df21-4868-a43d-93a988f3b6d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3320f39-5099-4ef0-a724-87cdef84be57]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] <== disconnect_volume: return (394ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "e83d61e5-b030-4353-9355-d83875c3be36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "e83d61e5-b030-4353-9355-d83875c3be36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "e83d61e5-b030-4353-9355-d83875c3be36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:29 user nova-compute[75026]: INFO nova.compute.manager [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Terminating instance
Nov 10 19:19:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:19:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lazy-loading 'flavor' on Instance uuid 766b49e2-52e5-4184-a870-0aa4e53f38ea {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:30 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 09a67456-da2f-4478-8c9a-6cac0e505134 is timed out.
Nov 10 19:19:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Successfully detached device vdb from instance 09a67456-da2f-4478-8c9a-6cac0e505134 from the live domain config.
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zXRuMKpc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:30 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8190ebef-d9e4-41b0-99b5-7bbb74b5d274]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:19:30 user nova-compute[75026]: No targets found.
Nov 10 19:19:30 user nova-compute[75026]: iSNS:
Nov 10 19:19:30 user nova-compute[75026]: No targets found.
Nov 10 19:19:30 user nova-compute[75026]: STATIC:
Nov 10 19:19:30 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34
Nov 10 19:19:30 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:30 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:30 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08
Nov 10 19:19:30 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:30 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:30 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88
Nov 10 19:19:30 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:30 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:30 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee
Nov 10 19:19:30 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:30 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:30 user nova-compute[75026]: FIRMWARE:
Nov 10 19:19:30 user nova-compute[75026]: No targets found.
Nov 10 19:19:30 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:19:30 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:19:30 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc7b1bf-00b1-491c-a373-81b040a35429]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5fdfc782-3257-467f-b4fa-1fc801ff1205 tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.179s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8518fd-ebb0-476a-b09c-4b9bcd073506]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:30 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:30 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:30 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:30 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:30 user nova-compute[75026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee (non-flash)
Nov 10 19:19:30 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:30 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:30 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed98130430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee'): ({'sdd'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Removing single pathed devices sdd {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a7ee9b-c296-45c4-ba9f-4746c83e948e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[479be971-f21a-4930-879e-e556c46c5fc4]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Flushing IO for device /dev/sdd {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0995843-5e95-4347-8158-0ada8ce9b5c2]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad718c1d-3c8d-47b7-a2fb-afd006cf8caa]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c982f416-c803-44a2-8ee2-ed0b009c6c3b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d80c7d-44f0-4fa5-ab35-f2c646adfc60]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee, portal: 172.16.0.220,3260]
Nov 10 19:19:30 user nova-compute[75026]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee, portal: 172.16.0.220,3260] successful.
Nov 10 19:19:30 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf1bad9-7689-4c90-9ce6-7c6199a4e9ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9371d46a-86b7-414f-abf8-91837194315b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] <== disconnect_volume: return (359ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Instance destroyed successfully.
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lazy-loading 'resources' on Instance uuid e83d61e5-b030-4353-9355-d83875c3be36 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-961534194',display_name='tempest-VolumesNegativeTest-instance-961534194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-961534194',id=9,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e7ecfc0fa084a4dbb43afdb4ec96598',ramdisk_id='',reservation_id='r-lk50u5q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1538555898',owner_user_name='tempest-VolumesNegativeTest-1538555898-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:47Z,user_data=None,user_id='4c0c6d9ac01c4ae5af13cbd390a08a1c',uuid=e83d61e5-b030-4353-9355-d83875c3be36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Converting VIF {"id": "666d2984-3003-4e57-9c66-042fa756843a", "address": "fa:16:3e:79:88:46", "network": {"id": "962b1910-e0d7-4672-adf8-d7a110f3af0a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9f10d948577b407181ab3af2309a1703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap666d2984-30", "ovs_interfaceid": "666d2984-3003-4e57-9c66-042fa756843a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:88:46,bridge_name='br-int',has_traffic_filtering=True,id=666d2984-3003-4e57-9c66-042fa756843a,network=Network(962b1910-e0d7-4672-adf8-d7a110f3af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666d2984-30') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG os_vif [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:88:46,bridge_name='br-int',has_traffic_filtering=True,id=666d2984-3003-4e57-9c66-042fa756843a,network=Network(962b1910-e0d7-4672-adf8-d7a110f3af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666d2984-30') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap666d2984-30, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a805c17b-b710-480d-9b3d-6c3cc3e3aaff) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:30 user nova-compute[75026]: INFO os_vif [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:88:46,bridge_name='br-int',has_traffic_filtering=True,id=666d2984-3003-4e57-9c66-042fa756843a,network=Network(962b1910-e0d7-4672-adf8-d7a110f3af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap666d2984-30')
Nov 10 19:19:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Deleting instance files /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36_del
Nov 10 19:19:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Deletion of /opt/stack/data/nova/instances/e83d61e5-b030-4353-9355-d83875c3be36_del complete
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-04ef6e94-aee2-4298-af7a-c24a209ebeb1 req-92c47925-2867-4551-a3de-fd77f67cde2b service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received event network-vif-unplugged-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04ef6e94-aee2-4298-af7a-c24a209ebeb1 req-92c47925-2867-4551-a3de-fd77f67cde2b service nova] Acquiring lock "e83d61e5-b030-4353-9355-d83875c3be36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04ef6e94-aee2-4298-af7a-c24a209ebeb1 req-92c47925-2867-4551-a3de-fd77f67cde2b service nova] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04ef6e94-aee2-4298-af7a-c24a209ebeb1 req-92c47925-2867-4551-a3de-fd77f67cde2b service nova] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-04ef6e94-aee2-4298-af7a-c24a209ebeb1 req-92c47925-2867-4551-a3de-fd77f67cde2b service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] No waiting events found dispatching network-vif-unplugged-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-04ef6e94-aee2-4298-af7a-c24a209ebeb1 req-92c47925-2867-4551-a3de-fd77f67cde2b service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received event network-vif-unplugged-666d2984-3003-4e57-9c66-042fa756843a for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:19:30 user nova-compute[75026]: INFO nova.compute.manager [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: e83d61e5-b030-4353-9355-d83875c3be36] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:30 user nova-compute[75026]: INFO nova.compute.manager [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Terminating instance
Nov 10 19:19:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:19:31 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Took 0.62 seconds to deallocate network for instance.
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-77701245-f362-4d8b-b426-65cc71b44e8f req-f41f7078-c8f8-457e-9efa-c011a009950b service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received event network-vif-deleted-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Instance destroyed successfully.
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lazy-loading 'resources' on Instance uuid 766b49e2-52e5-4184-a870-0aa4e53f38ea {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-278006354',display_name='tempest-AttachSCSIVolumeTestJSON-server-278006354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-278006354',id=4,image_ref='282d1b03-0b88-437c-afd4-7193c214172d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5a6rk/Bvm7Dx0ajqfT1NiDsEKSrB4IalFwLdkmIdGkYN8GQQ+EQmG6xzHzo3YAOYBuyNpzsio9/TQFX/rt/bbWl8jmhkQCdNshEL3JFqQmjFuhwQqAYD0HVQOTBF7eoQ==',key_name='tempest-keypair-483836031',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='293c2fa8bae04d4aafa2f16db1a5dd8f',ramdisk_id='',reservation_id='r-d50yq7vc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='282d1b03-0b88-437c-afd4-7193c214172d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-948162593',owner_user_name='tempest-AttachSCSIVolumeTestJSON-948162593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:16:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45aeefe8fd764ef6a0742280b30e6c8a',uuid=766b49e2-52e5-4184-a870-0aa4e53f38ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Converting VIF {"id": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "address": "fa:16:3e:d6:81:23", "network": {"id": "75547ab8-06fc-4c97-a91d-1eff66a4aa3a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1314221436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293c2fa8bae04d4aafa2f16db1a5dd8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1204de9a-a1", "ovs_interfaceid": "1204de9a-a15a-41b6-90d3-b475a3fc9561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:81:23,bridge_name='br-int',has_traffic_filtering=True,id=1204de9a-a15a-41b6-90d3-b475a3fc9561,network=Network(75547ab8-06fc-4c97-a91d-1eff66a4aa3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1204de9a-a1') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG os_vif [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:81:23,bridge_name='br-int',has_traffic_filtering=True,id=1204de9a-a15a-41b6-90d3-b475a3fc9561,network=Network(75547ab8-06fc-4c97-a91d-1eff66a4aa3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1204de9a-a1') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1204de9a-a1, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7939cf68-b3b5-4081-b87e-e44d5feb732d) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:19:31 user nova-compute[75026]: INFO os_vif [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:81:23,bridge_name='br-int',has_traffic_filtering=True,id=1204de9a-a15a-41b6-90d3-b475a3fc9561,network=Network(75547ab8-06fc-4c97-a91d-1eff66a4aa3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1204de9a-a1')
Nov 10 19:19:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Deleting instance files /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea_del
Nov 10 19:19:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Deletion of /opt/stack/data/nova/instances/766b49e2-52e5-4184-a870-0aa4e53f38ea_del complete
Nov 10 19:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.objects.instance [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lazy-loading 'flavor' on Instance uuid 09a67456-da2f-4478-8c9a-6cac0e505134 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:31 user nova-compute[75026]: INFO nova.compute.manager [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 10 19:19:31 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:19:31 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-00df0b4e-8401-4901-b89e-b6f532384b48 tempest-VolumesAssistedSnapshotsTest-41911867 tempest-VolumesAssistedSnapshotsTest-41911867-project-admin] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.401s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.637s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Deleted allocations for instance e83d61e5-b030-4353-9355-d83875c3be36
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b5308a0b-9180-4876-974d-f96d47624a23 tempest-VolumesNegativeTest-1538555898 tempest-VolumesNegativeTest-1538555898-project-member] Lock "e83d61e5-b030-4353-9355-d83875c3be36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.453s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received event network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Acquiring lock "e83d61e5-b030-4353-9355-d83875c3be36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "e83d61e5-b030-4353-9355-d83875c3be36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] No waiting events found dispatching network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:32 user nova-compute[75026]: WARNING nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: e83d61e5-b030-4353-9355-d83875c3be36] Received unexpected event network-vif-plugged-666d2984-3003-4e57-9c66-042fa756843a for instance with vm_state deleted and task_state None.
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-unplugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] No waiting events found dispatching network-vif-unplugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-unplugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] No waiting events found dispatching network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:32 user nova-compute[75026]: WARNING nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received unexpected event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 for instance with vm_state active and task_state deleting.
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] No waiting events found dispatching network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:32 user nova-compute[75026]: WARNING nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received unexpected event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 for instance with vm_state active and task_state deleting.
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] No waiting events found dispatching network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:32 user nova-compute[75026]: WARNING nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received unexpected event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 for instance with vm_state active and task_state deleting.
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-unplugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] No waiting events found dispatching network-vif-unplugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-unplugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Acquiring lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] No waiting events found dispatching network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:32 user nova-compute[75026]: WARNING nova.compute.manager [req-a01c7b4e-2e60-431b-88b5-ccdf1df5a454 req-c1311c3d-b9a3-44c3-b0bb-aad67ed914de service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received unexpected event network-vif-plugged-1204de9a-a15a-41b6-90d3-b475a3fc9561 for instance with vm_state active and task_state deleting.
Nov 10 19:19:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:19:33 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Took 1.28 seconds to deallocate network for instance.
Nov 10 19:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-7e5b87a7-d9cd-412a-9e00-f90bc6cb668e req-0b930ab6-3f88-4b5c-8e74-31be3aa96c9c service nova] [instance: 766b49e2-52e5-4184-a870-0aa4e53f38ea] Received event network-vif-deleted-1204de9a-a15a-41b6-90d3-b475a3fc9561 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:33 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Deleted allocations for instance 766b49e2-52e5-4184-a870-0aa4e53f38ea
Nov 10 19:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f297748f-1bf5-415f-bb9c-786e76429b5e tempest-AttachSCSIVolumeTestJSON-948162593 tempest-AttachSCSIVolumeTestJSON-948162593-project-member] Lock "766b49e2-52e5-4184-a870-0aa4e53f38ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.859s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:19:33 user nova-compute[75026]: INFO nova.compute.claims [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Claim successful on node user
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.network.neutron [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:19:34 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.policy [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '579c51e84dc948dcadf42c8b7f8fe2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e929bc4ed12347bc89619424def602a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:19:34 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Creating image(s)
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "/opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "/opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "/opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk 1073741824" returned: 0 in 0.049s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Successfully created port: 6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.167s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Cannot resize image /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Ensure instance console log exists: /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Successfully updated port: 6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquired lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-94c1ab60-bb74-4368-9702-c577ddc9fd73 req-96530679-8ded-4d53-b041-47e052de6dd1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received event network-changed-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-94c1ab60-bb74-4368-9702-c577ddc9fd73 req-96530679-8ded-4d53-b041-47e052de6dd1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Refreshing instance network info cache due to event network-changed-6b6224ed-0ed5-4643-9ae0-ae460f8347b6. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-94c1ab60-bb74-4368-9702-c577ddc9fd73 req-96530679-8ded-4d53-b041-47e052de6dd1 service nova] Acquiring lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Updating instance_info_cache with network_info: [{"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Releasing lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Instance network_info: |[{"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-94c1ab60-bb74-4368-9702-c577ddc9fd73 req-96530679-8ded-4d53-b041-47e052de6dd1 service nova] Acquired lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.network.neutron [req-94c1ab60-bb74-4368-9702-c577ddc9fd73 req-96530679-8ded-4d53-b041-47e052de6dd1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Refreshing network info cache for port 6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Start _get_guest_xml network_info=[{"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:19:35 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:19:35 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1462598103',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1462598103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1462598',id=12,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDYBzuRNmUvSH3jE33C/swn6QVkUov5mdoHqC3AMhHCRb8+jmpDBiq0uOcx5DsDKCKluGlNdpe7nBXyWoxEB9kLa1zPMsArCFStA34f2nOcnMGMDP13gRnce90B9dWnww==',key_name='tempest-keypair-1300822874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e929bc4ed12347bc89619424def602a4',ramdisk_id='',reservation_id='r-07qt0n6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1864760290',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c51e84dc948dcadf42c8b7f8fe2f7',uuid=f86437d3-8401-4c25-8122-1dcb98c1cd19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Converting VIF {"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fc:ef,bridge_name='br-int',has_traffic_filtering=True,id=6b6224ed-0ed5-4643-9ae0-ae460f8347b6,network=Network(963af7c1-f2a9-4cff-8187-1e0b43f80fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6224ed-0e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.objects.instance [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lazy-loading 'pci_devices' on Instance uuid f86437d3-8401-4c25-8122-1dcb98c1cd19 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:19:36 user nova-compute[75026]:   <uuid>f86437d3-8401-4c25-8122-1dcb98c1cd19</uuid>
Nov 10 19:19:36 user nova-compute[75026]:   <name>instance-0000000c</name>
Nov 10 19:19:36 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:19:36 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:19:36 user nova-compute[75026]:   <metadata>
Nov 10 19:19:36 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:19:36 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:19:36 user nova-compute[75026]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1462598103</nova:name>
Nov 10 19:19:36 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:19:35</nova:creationTime>
Nov 10 19:19:36 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:19:36 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:19:36 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:19:36 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:19:36 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:19:36 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:19:36 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:19:36 user nova-compute[75026]:       <nova:owner>
Nov 10 19:19:36 user nova-compute[75026]:         <nova:user uuid="579c51e84dc948dcadf42c8b7f8fe2f7">tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member</nova:user>
Nov 10 19:19:36 user nova-compute[75026]:         <nova:project uuid="e929bc4ed12347bc89619424def602a4">tempest-TestServerVolumeAttachScenarioOldVersion-1864760290</nova:project>
Nov 10 19:19:36 user nova-compute[75026]:       </nova:owner>
Nov 10 19:19:36 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:19:36 user nova-compute[75026]:       <nova:ports>
Nov 10 19:19:36 user nova-compute[75026]:         <nova:port uuid="6b6224ed-0ed5-4643-9ae0-ae460f8347b6">
Nov 10 19:19:36 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 19:19:36 user nova-compute[75026]:         </nova:port>
Nov 10 19:19:36 user nova-compute[75026]:       </nova:ports>
Nov 10 19:19:36 user nova-compute[75026]:     </nova:instance>
Nov 10 19:19:36 user nova-compute[75026]:   </metadata>
Nov 10 19:19:36 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:19:36 user nova-compute[75026]:     <system>
Nov 10 19:19:36 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:19:36 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:19:36 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:19:36 user nova-compute[75026]:       <entry name="serial">f86437d3-8401-4c25-8122-1dcb98c1cd19</entry>
Nov 10 19:19:36 user nova-compute[75026]:       <entry name="uuid">f86437d3-8401-4c25-8122-1dcb98c1cd19</entry>
Nov 10 19:19:36 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:19:36 user nova-compute[75026]:     </system>
Nov 10 19:19:36 user nova-compute[75026]:   </sysinfo>
Nov 10 19:19:36 user nova-compute[75026]:   <os>
Nov 10 19:19:36 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:19:36 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:19:36 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:19:36 user nova-compute[75026]:   </os>
Nov 10 19:19:36 user nova-compute[75026]:   <features>
Nov 10 19:19:36 user nova-compute[75026]:     <acpi/>
Nov 10 19:19:36 user nova-compute[75026]:     <apic/>
Nov 10 19:19:36 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:19:36 user nova-compute[75026]:   </features>
Nov 10 19:19:36 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:19:36 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:19:36 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:19:36 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:19:36 user nova-compute[75026]:   </clock>
Nov 10 19:19:36 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:19:36 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:19:36 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:19:36 user nova-compute[75026]:   </cpu>
Nov 10 19:19:36 user nova-compute[75026]:   <devices>
Nov 10 19:19:36 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:19:36 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:19:36 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk"/>
Nov 10 19:19:36 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:19:36 user nova-compute[75026]:     </disk>
Nov 10 19:19:36 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:19:36 user nova-compute[75026]:       <mac address="fa:16:3e:56:fc:ef"/>
Nov 10 19:19:36 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:19:36 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:19:36 user nova-compute[75026]:       <target dev="tap6b6224ed-0e"/>
Nov 10 19:19:36 user nova-compute[75026]:     </interface>
Nov 10 19:19:36 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:19:36 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/console.log" append="off"/>
Nov 10 19:19:36 user nova-compute[75026]:     </serial>
Nov 10 19:19:36 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:19:36 user nova-compute[75026]:     <video>
Nov 10 19:19:36 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:19:36 user nova-compute[75026]:     </video>
Nov 10 19:19:36 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:19:36 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:19:36 user nova-compute[75026]:     </rng>
Nov 10 19:19:36 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:19:36 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:19:36 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:19:36 user nova-compute[75026]:     </memballoon>
Nov 10 19:19:36 user nova-compute[75026]:   </devices>
Nov 10 19:19:36 user nova-compute[75026]: </domain>
Nov 10 19:19:36 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1462598103',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1462598103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1462598',id=12,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDYBzuRNmUvSH3jE33C/swn6QVkUov5mdoHqC3AMhHCRb8+jmpDBiq0uOcx5DsDKCKluGlNdpe7nBXyWoxEB9kLa1zPMsArCFStA34f2nOcnMGMDP13gRnce90B9dWnww==',key_name='tempest-keypair-1300822874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e929bc4ed12347bc89619424def602a4',ramdisk_id='',reservation_id='r-07qt0n6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1864760290',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c51e84dc948dcadf42c8b7f8fe2f7',uuid=f86437d3-8401-4c25-8122-1dcb98c1cd19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Converting VIF {"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fc:ef,bridge_name='br-int',has_traffic_filtering=True,id=6b6224ed-0ed5-4643-9ae0-ae460f8347b6,network=Network(963af7c1-f2a9-4cff-8187-1e0b43f80fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6224ed-0e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG os_vif [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fc:ef,bridge_name='br-int',has_traffic_filtering=True,id=6b6224ed-0ed5-4643-9ae0-ae460f8347b6,network=Network(963af7c1-f2a9-4cff-8187-1e0b43f80fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6224ed-0e') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75dad8d8-b300-5c27-8817-b86fd3c0a727', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b6224ed-0e, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b6224ed-0e, col_values=(('qos', UUID('7c87f0ea-2d95-4200-a6ab-c0eda2dcb1f4')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b6224ed-0e, col_values=(('external_ids', {'iface-id': '6b6224ed-0ed5-4643-9ae0-ae460f8347b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:fc:ef', 'vm-uuid': 'f86437d3-8401-4c25-8122-1dcb98c1cd19'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:36 user nova-compute[75026]: INFO os_vif [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fc:ef,bridge_name='br-int',has_traffic_filtering=True,id=6b6224ed-0ed5-4643-9ae0-ae460f8347b6,network=Network(963af7c1-f2a9-4cff-8187-1e0b43f80fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6224ed-0e')
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] No VIF found with MAC fa:16:3e:56:fc:ef, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.network.neutron [req-94c1ab60-bb74-4368-9702-c577ddc9fd73 req-96530679-8ded-4d53-b041-47e052de6dd1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Updated VIF entry in instance network info cache for port 6b6224ed-0ed5-4643-9ae0-ae460f8347b6. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG nova.network.neutron [req-94c1ab60-bb74-4368-9702-c577ddc9fd73 req-96530679-8ded-4d53-b041-47e052de6dd1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Updating instance_info_cache with network_info: [{"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:19:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-94c1ab60-bb74-4368-9702-c577ddc9fd73 req-96530679-8ded-4d53-b041-47e052de6dd1 service nova] Releasing lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-f7d28d5a-1868-40de-8319-b977894b9d19 req-b1c2e506-b52b-4c25-9cbd-e4041c2ee50b service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received event network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f7d28d5a-1868-40de-8319-b977894b9d19 req-b1c2e506-b52b-4c25-9cbd-e4041c2ee50b service nova] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f7d28d5a-1868-40de-8319-b977894b9d19 req-b1c2e506-b52b-4c25-9cbd-e4041c2ee50b service nova] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f7d28d5a-1868-40de-8319-b977894b9d19 req-b1c2e506-b52b-4c25-9cbd-e4041c2ee50b service nova] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-f7d28d5a-1868-40de-8319-b977894b9d19 req-b1c2e506-b52b-4c25-9cbd-e4041c2ee50b service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] No waiting events found dispatching network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:37 user nova-compute[75026]: WARNING nova.compute.manager [req-f7d28d5a-1868-40de-8319-b977894b9d19 req-b1c2e506-b52b-4c25-9cbd-e4041c2ee50b service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received unexpected event network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 for instance with vm_state building and task_state spawning.
Nov 10 19:19:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:19:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Instance spawned successfully.
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:19:39 user nova-compute[75026]: INFO nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-6e93793a-184a-444e-9b84-c8cc87c4de8b req-c365e27e-b6f6-4888-9e84-3b51741aa3b8 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received event network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6e93793a-184a-444e-9b84-c8cc87c4de8b req-c365e27e-b6f6-4888-9e84-3b51741aa3b8 service nova] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6e93793a-184a-444e-9b84-c8cc87c4de8b req-c365e27e-b6f6-4888-9e84-3b51741aa3b8 service nova] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6e93793a-184a-444e-9b84-c8cc87c4de8b req-c365e27e-b6f6-4888-9e84-3b51741aa3b8 service nova] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-6e93793a-184a-444e-9b84-c8cc87c4de8b req-c365e27e-b6f6-4888-9e84-3b51741aa3b8 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] No waiting events found dispatching network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:39 user nova-compute[75026]: WARNING nova.compute.manager [req-6e93793a-184a-444e-9b84-c8cc87c4de8b req-c365e27e-b6f6-4888-9e84-3b51741aa3b8 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received unexpected event network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 for instance with vm_state active and task_state None.
Nov 10 19:19:39 user nova-compute[75026]: INFO nova.compute.manager [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Took 5.86 seconds to build instance.
Nov 10 19:19:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-835abde3-d263-46e4-bb06-4f6dff8241b2 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.962s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:40 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d57c5ada-750c-41af-a14c-6546374cf5d2 is timed out.
Nov 10 19:19:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Successfully detached device vdb from instance d57c5ada-750c-41af-a14c-6546374cf5d2 from the live domain config.
Nov 10 19:19:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcFbmLJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8038a4-9129-469e-83f7-77bd1a17025a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:19:40 user nova-compute[75026]: No targets found.
Nov 10 19:19:40 user nova-compute[75026]: iSNS:
Nov 10 19:19:40 user nova-compute[75026]: No targets found.
Nov 10 19:19:40 user nova-compute[75026]: STATIC:
Nov 10 19:19:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34
Nov 10 19:19:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08
Nov 10 19:19:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88
Nov 10 19:19:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:40 user nova-compute[75026]: FIRMWARE:
Nov 10 19:19:40 user nova-compute[75026]: No targets found.
Nov 10 19:19:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:19:40 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:19:40 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b615d9-6d44-45c0-a9f7-ff384e5a0710]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[29338ac4-a0ac-499f-9222-39baa4947f9e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:40 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:40 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:40 user nova-compute[75026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 (non-flash)
Nov 10 19:19:40 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0399870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34'): ({'sde'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Removing single pathed devices sde {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b02135e-c510-4547-95e8-1de9cf2bc825]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e7ac91-babe-41f2-a3c3-235ee87426f6]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Flushing IO for device /dev/sde {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[befcecb3-4181-4330-9231-88a044fbf01d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3112a38-8000-4b94-acb6-bed38442d761]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] SCSI volumes sde have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e314f78d-55f3-4f66-adde-64e8e016d74d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[448451e6-85c3-4e73-a088-7ed81a720984]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34, portal: 172.16.0.220,3260]
Nov 10 19:19:40 user nova-compute[75026]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34, portal: 172.16.0.220,3260] successful.
Nov 10 19:19:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ae43d62-e444-438c-af88-addd14b2fd34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea1b409-c642-432e-84e7-becce6e0eb95]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] <== disconnect_volume: return (306ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:19:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:41 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lazy-loading 'flavor' on Instance uuid d57c5ada-750c-41af-a14c-6546374cf5d2 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fa042f5b-19a8-46d7-8ad2-118a2d4c9fe2 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.952s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:42 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4fc47635-99d4-47a8-a482-022d75931831 is timed out.
Nov 10 19:19:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Successfully detached device vdb from instance 4fc47635-99d4-47a8-a482-022d75931831 from the live domain config.
Nov 10 19:19:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQoBbCkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:42 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eee2fe3-22ba-47d0-96f6-98f954716e50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:19:42 user nova-compute[75026]: No targets found.
Nov 10 19:19:42 user nova-compute[75026]: iSNS:
Nov 10 19:19:42 user nova-compute[75026]: No targets found.
Nov 10 19:19:42 user nova-compute[75026]: STATIC:
Nov 10 19:19:42 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08
Nov 10 19:19:42 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:42 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:42 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88
Nov 10 19:19:42 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:19:42 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:19:42 user nova-compute[75026]: FIRMWARE:
Nov 10 19:19:42 user nova-compute[75026]: No targets found.
Nov 10 19:19:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:19:42 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:19:42 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beacaa5-8361-45f5-a1fe-73e8ade400ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c9950-ad1d-4a82-83cc-edf50f2a77d8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:42 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:42 user nova-compute[75026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 (non-flash)
Nov 10 19:19:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda039bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08'): ({'sdf'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Removing single pathed devices sdf {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7388b70-ec15-4bb6-9a74-7efb4100ad6d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c621ae3c-63c7-40a9-97b4-680cb5f6d4e5]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Flushing IO for device /dev/sdf {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[37481b67-ac08-41f2-9ce6-ddb1a7f69877]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e49a6a-7b39-4d43-bd4c-59956de04c0a]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] SCSI volumes sdf have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c461949-e020-4327-8f42-0d062d85f1ab]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c885a-5f08-464c-895a-ac20a69de56f]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08, portal: 172.16.0.220,3260]
Nov 10 19:19:42 user nova-compute[75026]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08, portal: 172.16.0.220,3260] successful.
Nov 10 19:19:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3ca0ba-1710-49f9-9243-60f4e4c9cf08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf94604-f7f9-4e95-b760-2730bd2c3618]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] <== disconnect_volume: return (314ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:19:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:43 user nova-compute[75026]: DEBUG nova.objects.instance [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lazy-loading 'flavor' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc7051b2-8a99-4606-85c7-e64f69754456 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.096s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "interface-4fc47635-99d4-47a8-a482-022d75931831-f9563120-8021-4e77-9ce5-ab5cf8e39cf0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "interface-4fc47635-99d4-47a8-a482-022d75931831-f9563120-8021-4e77-9ce5-ab5cf8e39cf0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lazy-loading 'flavor' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converting VIF {"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface> {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface> {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Attempting to detach device tapf9563120-80 from instance 4fc47635-99d4-47a8-a482-022d75931831 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] detach device xml: <interface type="ethernet">
Nov 10 19:19:44 user nova-compute[75026]:   <mac address="fa:16:3e:86:50:d4"/>
Nov 10 19:19:44 user nova-compute[75026]:   <model type="virtio"/>
Nov 10 19:19:44 user nova-compute[75026]:   <mtu size="1442"/>
Nov 10 19:19:44 user nova-compute[75026]:   <target dev="tapf9563120-80"/>
Nov 10 19:19:44 user nova-compute[75026]: </interface>
Nov 10 19:19:44 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface> {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 10 19:19:44 user nova-compute[75026]:   <name>instance-00000007</name>
Nov 10 19:19:44 user nova-compute[75026]:   <uuid>4fc47635-99d4-47a8-a482-022d75931831</uuid>
Nov 10 19:19:44 user nova-compute[75026]:   <metadata>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:19:44 user nova-compute[75026]:   <nova:package version="0.0.0"/>
Nov 10 19:19:44 user nova-compute[75026]:   <nova:name>tempest-device-tagging-server-1709409501</nova:name>
Nov 10 19:19:44 user nova-compute[75026]:   <nova:creationTime>2023-11-10 19:18:47</nova:creationTime>
Nov 10 19:19:44 user nova-compute[75026]:   <nova:flavor name="m1.tiny">
Nov 10 19:19:44 user nova-compute[75026]:     <nova:memory>512</nova:memory>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:disk>1</nova:disk>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:swap>0</nova:swap>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:vcpus>1</nova:vcpus>
Nov 10 19:19:44 user nova-compute[75026]:   </nova:flavor>
Nov 10 19:19:44 user nova-compute[75026]:   <nova:owner>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:user uuid="a0eb014a1e2a42ce8f33dcf814421229">tempest-TaggedAttachmentsTest-617120050-project-member</nova:user>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:project uuid="32dc3afe879d475a96ad9312fec0c3e9">tempest-TaggedAttachmentsTest-617120050</nova:project>
Nov 10 19:19:44 user nova-compute[75026]:   </nova:owner>
Nov 10 19:19:44 user nova-compute[75026]:   <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:19:44 user nova-compute[75026]:   <nova:ports>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:port uuid="8f2f1337-bb4e-4cc0-892d-418b29969d56">
Nov 10 19:19:44 user nova-compute[75026]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:19:44 user nova-compute[75026]:     </nova:port>
Nov 10 19:19:44 user nova-compute[75026]:     <nova:port uuid="f9563120-8021-4e77-9ce5-ab5cf8e39cf0">
Nov 10 19:19:44 user nova-compute[75026]:       <nova:ip type="fixed" address="10.10.10.133" ipVersion="4"/>
Nov 10 19:19:44 user nova-compute[75026]:     </nova:port>
Nov 10 19:19:44 user nova-compute[75026]:   </nova:ports>
Nov 10 19:19:44 user nova-compute[75026]: </nova:instance>
Nov 10 19:19:44 user nova-compute[75026]:   </metadata>
Nov 10 19:19:44 user nova-compute[75026]:   <memory unit='KiB'>524288</memory>
Nov 10 19:19:44 user nova-compute[75026]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 19:19:44 user nova-compute[75026]:   <vcpu placement='static'>1</vcpu>
Nov 10 19:19:44 user nova-compute[75026]:   <resource>
Nov 10 19:19:44 user nova-compute[75026]:     <partition>/machine</partition>
Nov 10 19:19:44 user nova-compute[75026]:   </resource>
Nov 10 19:19:44 user nova-compute[75026]:   <sysinfo type='smbios'>
Nov 10 19:19:44 user nova-compute[75026]:     <system>
Nov 10 19:19:44 user nova-compute[75026]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 19:19:44 user nova-compute[75026]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 19:19:44 user nova-compute[75026]:       <entry name='version'>0.0.0</entry>
Nov 10 19:19:44 user nova-compute[75026]:       <entry name='serial'>4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:19:44 user nova-compute[75026]:       <entry name='uuid'>4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:19:44 user nova-compute[75026]:       <entry name='family'>Virtual Machine</entry>
Nov 10 19:19:44 user nova-compute[75026]:     </system>
Nov 10 19:19:44 user nova-compute[75026]:   </sysinfo>
Nov 10 19:19:44 user nova-compute[75026]:   <os>
Nov 10 19:19:44 user nova-compute[75026]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 19:19:44 user nova-compute[75026]:     <boot dev='hd'/>
Nov 10 19:19:44 user nova-compute[75026]:     <smbios mode='sysinfo'/>
Nov 10 19:19:44 user nova-compute[75026]:   </os>
Nov 10 19:19:44 user nova-compute[75026]:   <features>
Nov 10 19:19:44 user nova-compute[75026]:     <acpi/>
Nov 10 19:19:44 user nova-compute[75026]:     <apic/>
Nov 10 19:19:44 user nova-compute[75026]:     <vmcoreinfo state='on'/>
Nov 10 19:19:44 user nova-compute[75026]:   </features>
Nov 10 19:19:44 user nova-compute[75026]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 19:19:44 user nova-compute[75026]:     <model fallback='forbid'>Nehalem</model>
Nov 10 19:19:44 user nova-compute[75026]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 19:19:44 user nova-compute[75026]:     <feature policy='require' name='vme'/>
Nov 10 19:19:44 user nova-compute[75026]:     <feature policy='require' name='x2apic'/>
Nov 10 19:19:44 user nova-compute[75026]:     <feature policy='require' name='hypervisor'/>
Nov 10 19:19:44 user nova-compute[75026]:   </cpu>
Nov 10 19:19:44 user nova-compute[75026]:   <clock offset='utc'>
Nov 10 19:19:44 user nova-compute[75026]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 19:19:44 user nova-compute[75026]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 19:19:44 user nova-compute[75026]:     <timer name='hpet' present='no'/>
Nov 10 19:19:44 user nova-compute[75026]:   </clock>
Nov 10 19:19:44 user nova-compute[75026]:   <on_poweroff>destroy</on_poweroff>
Nov 10 19:19:44 user nova-compute[75026]:   <on_reboot>restart</on_reboot>
Nov 10 19:19:44 user nova-compute[75026]:   <on_crash>destroy</on_crash>
Nov 10 19:19:44 user nova-compute[75026]:   <devices>
Nov 10 19:19:44 user nova-compute[75026]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 19:19:44 user nova-compute[75026]:     <disk type='file' device='disk'>
Nov 10 19:19:44 user nova-compute[75026]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 19:19:44 user nova-compute[75026]:       <source file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk' index='2'/>
Nov 10 19:19:44 user nova-compute[75026]:       <backingStore type='file' index='3'>
Nov 10 19:19:44 user nova-compute[75026]:         <format type='raw'/>
Nov 10 19:19:44 user nova-compute[75026]:         <source file='/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd'/>
Nov 10 19:19:44 user nova-compute[75026]:         <backingStore/>
Nov 10 19:19:44 user nova-compute[75026]:       </backingStore>
Nov 10 19:19:44 user nova-compute[75026]:       <target dev='vda' bus='virtio'/>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='virtio-disk0'/>
Nov 10 19:19:44 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </disk>
Nov 10 19:19:44 user nova-compute[75026]:     <disk type='file' device='cdrom'>
Nov 10 19:19:44 user nova-compute[75026]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 19:19:44 user nova-compute[75026]:       <source file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.config' index='1'/>
Nov 10 19:19:44 user nova-compute[75026]:       <backingStore/>
Nov 10 19:19:44 user nova-compute[75026]:       <target dev='hda' bus='ide'/>
Nov 10 19:19:44 user nova-compute[75026]:       <readonly/>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='ide0-0-0'/>
Nov 10 19:19:44 user nova-compute[75026]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </disk>
Nov 10 19:19:44 user nova-compute[75026]:     <controller type='usb' index='0' model='none'>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='usb'/>
Nov 10 19:19:44 user nova-compute[75026]:     </controller>
Nov 10 19:19:44 user nova-compute[75026]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='pci.0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </controller>
Nov 10 19:19:44 user nova-compute[75026]:     <controller type='ide' index='0'>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='ide'/>
Nov 10 19:19:44 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 19:19:44 user nova-compute[75026]:     </controller>
Nov 10 19:19:44 user nova-compute[75026]:     <interface type='ethernet'>
Nov 10 19:19:44 user nova-compute[75026]:       <mac address='fa:16:3e:49:9d:60'/>
Nov 10 19:19:44 user nova-compute[75026]:       <target dev='tap8f2f1337-bb'/>
Nov 10 19:19:44 user nova-compute[75026]:       <model type='virtio'/>
Nov 10 19:19:44 user nova-compute[75026]:       <mtu size='1442'/>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='net0'/>
Nov 10 19:19:44 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </interface>
Nov 10 19:19:44 user nova-compute[75026]:     <interface type='ethernet'>
Nov 10 19:19:44 user nova-compute[75026]:       <mac address='fa:16:3e:86:50:d4'/>
Nov 10 19:19:44 user nova-compute[75026]:       <target dev='tapf9563120-80'/>
Nov 10 19:19:44 user nova-compute[75026]:       <model type='virtio'/>
Nov 10 19:19:44 user nova-compute[75026]:       <mtu size='1442'/>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='net1'/>
Nov 10 19:19:44 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </interface>
Nov 10 19:19:44 user nova-compute[75026]:     <serial type='pty'>
Nov 10 19:19:44 user nova-compute[75026]:       <source path='/dev/pts/6'/>
Nov 10 19:19:44 user nova-compute[75026]:       <log file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log' append='off'/>
Nov 10 19:19:44 user nova-compute[75026]:       <target type='isa-serial' port='0'>
Nov 10 19:19:44 user nova-compute[75026]:         <model name='isa-serial'/>
Nov 10 19:19:44 user nova-compute[75026]:       </target>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='serial0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </serial>
Nov 10 19:19:44 user nova-compute[75026]:     <console type='pty' tty='/dev/pts/6'>
Nov 10 19:19:44 user nova-compute[75026]:       <source path='/dev/pts/6'/>
Nov 10 19:19:44 user nova-compute[75026]:       <log file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log' append='off'/>
Nov 10 19:19:44 user nova-compute[75026]:       <target type='serial' port='0'/>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='serial0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </console>
Nov 10 19:19:44 user nova-compute[75026]:     <input type='mouse' bus='ps2'>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='input0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </input>
Nov 10 19:19:44 user nova-compute[75026]:     <input type='keyboard' bus='ps2'>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='input1'/>
Nov 10 19:19:44 user nova-compute[75026]:     </input>
Nov 10 19:19:44 user nova-compute[75026]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 10 19:19:44 user nova-compute[75026]:       <listen type='address' address='0.0.0.0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </graphics>
Nov 10 19:19:44 user nova-compute[75026]:     <audio id='1' type='none'/>
Nov 10 19:19:44 user nova-compute[75026]:     <video>
Nov 10 19:19:44 user nova-compute[75026]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='video0'/>
Nov 10 19:19:44 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </video>
Nov 10 19:19:44 user nova-compute[75026]:     <memballoon model='virtio'>
Nov 10 19:19:44 user nova-compute[75026]:       <stats period='10'/>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='balloon0'/>
Nov 10 19:19:44 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </memballoon>
Nov 10 19:19:44 user nova-compute[75026]:     <rng model='virtio'>
Nov 10 19:19:44 user nova-compute[75026]:       <backend model='random'>/dev/urandom</backend>
Nov 10 19:19:44 user nova-compute[75026]:       <alias name='rng0'/>
Nov 10 19:19:44 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 19:19:44 user nova-compute[75026]:     </rng>
Nov 10 19:19:44 user nova-compute[75026]:   </devices>
Nov 10 19:19:44 user nova-compute[75026]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 19:19:44 user nova-compute[75026]:     <label>libvirt-4fc47635-99d4-47a8-a482-022d75931831</label>
Nov 10 19:19:44 user nova-compute[75026]:     <imagelabel>libvirt-4fc47635-99d4-47a8-a482-022d75931831</imagelabel>
Nov 10 19:19:44 user nova-compute[75026]:   </seclabel>
Nov 10 19:19:44 user nova-compute[75026]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 19:19:44 user nova-compute[75026]:     <label>+64055:+108</label>
Nov 10 19:19:44 user nova-compute[75026]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 19:19:44 user nova-compute[75026]:   </seclabel>
Nov 10 19:19:44 user nova-compute[75026]: </domain>
Nov 10 19:19:44 user nova-compute[75026]:  {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 19:19:44 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Successfully detached device tapf9563120-80 from instance 4fc47635-99d4-47a8-a482-022d75931831 from the persistent domain config.
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] (1/8): Attempting to detach device tapf9563120-80 with device alias net1 from instance 4fc47635-99d4-47a8-a482-022d75931831 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:19:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] detach device xml: <interface type="ethernet">
Nov 10 19:19:44 user nova-compute[75026]:   <mac address="fa:16:3e:86:50:d4"/>
Nov 10 19:19:44 user nova-compute[75026]:   <model type="virtio"/>
Nov 10 19:19:44 user nova-compute[75026]:   <mtu size="1442"/>
Nov 10 19:19:44 user nova-compute[75026]:   <target dev="tapf9563120-80"/>
Nov 10 19:19:44 user nova-compute[75026]: </interface>
Nov 10 19:19:44 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Start waiting for the detach event from libvirt for device tapf9563120-80 with device alias net1 for instance 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-3f91f1df-56d4-4d4b-9a56-dd54b39575c5 req-c4c7d769-6313-4675-9253-e44c914baa06 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-unplugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f91f1df-56d4-4d4b-9a56-dd54b39575c5 req-c4c7d769-6313-4675-9253-e44c914baa06 service nova] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f91f1df-56d4-4d4b-9a56-dd54b39575c5 req-c4c7d769-6313-4675-9253-e44c914baa06 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f91f1df-56d4-4d4b-9a56-dd54b39575c5 req-c4c7d769-6313-4675-9253-e44c914baa06 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-3f91f1df-56d4-4d4b-9a56-dd54b39575c5 req-c4c7d769-6313-4675-9253-e44c914baa06 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] No waiting events found dispatching network-vif-unplugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:45 user nova-compute[75026]: WARNING nova.compute.manager [req-3f91f1df-56d4-4d4b-9a56-dd54b39575c5 req-c4c7d769-6313-4675-9253-e44c914baa06 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received unexpected event network-vif-unplugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 for instance with vm_state active and task_state None.
Nov 10 19:19:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-6d4ff693-4add-4e69-9d85-ce6cc9ae1afe req-d41c8397-9acb-48a0-8ae1-987df1999c62 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6d4ff693-4add-4e69-9d85-ce6cc9ae1afe req-d41c8397-9acb-48a0-8ae1-987df1999c62 service nova] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6d4ff693-4add-4e69-9d85-ce6cc9ae1afe req-d41c8397-9acb-48a0-8ae1-987df1999c62 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6d4ff693-4add-4e69-9d85-ce6cc9ae1afe req-d41c8397-9acb-48a0-8ae1-987df1999c62 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-6d4ff693-4add-4e69-9d85-ce6cc9ae1afe req-d41c8397-9acb-48a0-8ae1-987df1999c62 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] No waiting events found dispatching network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:47 user nova-compute[75026]: WARNING nova.compute.manager [req-6d4ff693-4add-4e69-9d85-ce6cc9ae1afe req-d41c8397-9acb-48a0-8ae1-987df1999c62 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received unexpected event network-vif-plugged-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 for instance with vm_state active and task_state None.
Nov 10 19:19:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:50 user nova-compute[75026]: INFO nova.compute.manager [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Terminating instance
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-fd129cf8-deab-4da4-a231-1d25fff8ee56 req-af5326cc-ff9c-4c42-bbad-c435f43a05b7 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received event network-vif-unplugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fd129cf8-deab-4da4-a231-1d25fff8ee56 req-af5326cc-ff9c-4c42-bbad-c435f43a05b7 service nova] Acquiring lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fd129cf8-deab-4da4-a231-1d25fff8ee56 req-af5326cc-ff9c-4c42-bbad-c435f43a05b7 service nova] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fd129cf8-deab-4da4-a231-1d25fff8ee56 req-af5326cc-ff9c-4c42-bbad-c435f43a05b7 service nova] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-fd129cf8-deab-4da4-a231-1d25fff8ee56 req-af5326cc-ff9c-4c42-bbad-c435f43a05b7 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] No waiting events found dispatching network-vif-unplugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-fd129cf8-deab-4da4-a231-1d25fff8ee56 req-af5326cc-ff9c-4c42-bbad-c435f43a05b7 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received event network-vif-unplugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Instance destroyed successfully.
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.objects.instance [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lazy-loading 'resources' on Instance uuid a015e0b7-7ebd-407a-9bb5-697a0e5b8365 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1336349962',display_name='tempest-ServersNegativeTestJSON-server-1336349962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1336349962',id=11,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d16cff5b9b94e95b61b63e8ffd25066',ramdisk_id='',reservation_id='r-qt4cs8r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-527246051',owner_user_name='tempest-ServersNegativeTestJSON-527246051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:18:07Z,user_data=None,user_id='8448d842ea1f478392fbdb0c27afed56',uuid=a015e0b7-7ebd-407a-9bb5-697a0e5b8365,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converting VIF {"id": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "address": "fa:16:3e:4e:71:2f", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88405f0-cf", "ovs_interfaceid": "c88405f0-cfb1-4354-b3b0-d60c8e19867d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:71:2f,bridge_name='br-int',has_traffic_filtering=True,id=c88405f0-cfb1-4354-b3b0-d60c8e19867d,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88405f0-cf') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG os_vif [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:71:2f,bridge_name='br-int',has_traffic_filtering=True,id=c88405f0-cfb1-4354-b3b0-d60c8e19867d,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88405f0-cf') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc88405f0-cf, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0de4f71e-791d-4053-8863-ec2a78ba6dd8) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:50 user nova-compute[75026]: INFO os_vif [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:71:2f,bridge_name='br-int',has_traffic_filtering=True,id=c88405f0-cfb1-4354-b3b0-d60c8e19867d,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88405f0-cf')
Nov 10 19:19:50 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Deleting instance files /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365_del
Nov 10 19:19:50 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Deletion of /opt/stack/data/nova/instances/a015e0b7-7ebd-407a-9bb5-697a0e5b8365_del complete
Nov 10 19:19:50 user nova-compute[75026]: INFO nova.compute.manager [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 19:19:50 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:19:50 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:19:51 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:19:51 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Took 0.69 seconds to deallocate network for instance.
Nov 10 19:19:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-e8107724-e1b1-4a61-8702-538d0928a5b2 req-8f60aeb9-9e35-4275-8f52-6e34e3652018 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received event network-vif-deleted-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:51 user nova-compute[75026]: INFO nova.compute.manager [req-e8107724-e1b1-4a61-8702-538d0928a5b2 req-8f60aeb9-9e35-4275-8f52-6e34e3652018 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Neutron deleted interface c88405f0-cfb1-4354-b3b0-d60c8e19867d; detaching it from the instance and deleting it from the info cache
Nov 10 19:19:51 user nova-compute[75026]: DEBUG nova.network.neutron [req-e8107724-e1b1-4a61-8702-538d0928a5b2 req-8f60aeb9-9e35-4275-8f52-6e34e3652018 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:19:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-e8107724-e1b1-4a61-8702-538d0928a5b2 req-8f60aeb9-9e35-4275-8f52-6e34e3652018 service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Detach interface failed, port_id=c88405f0-cfb1-4354-b3b0-d60c8e19867d, reason: Instance a015e0b7-7ebd-407a-9bb5-697a0e5b8365 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:19:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:52 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:19:52 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:19:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:52 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Deleted allocations for instance a015e0b7-7ebd-407a-9bb5-697a0e5b8365
Nov 10 19:19:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-698c6fcd-a7e4-49a6-908c-b9fa16b02448 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.188s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-c8ad3eea-a32b-478b-96e8-3177a1e102bd req-0daac2e5-14c7-461e-b175-3b9e2da7749d service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received event network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:19:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8ad3eea-a32b-478b-96e8-3177a1e102bd req-0daac2e5-14c7-461e-b175-3b9e2da7749d service nova] Acquiring lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8ad3eea-a32b-478b-96e8-3177a1e102bd req-0daac2e5-14c7-461e-b175-3b9e2da7749d service nova] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8ad3eea-a32b-478b-96e8-3177a1e102bd req-0daac2e5-14c7-461e-b175-3b9e2da7749d service nova] Lock "a015e0b7-7ebd-407a-9bb5-697a0e5b8365-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-c8ad3eea-a32b-478b-96e8-3177a1e102bd req-0daac2e5-14c7-461e-b175-3b9e2da7749d service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] No waiting events found dispatching network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:19:52 user nova-compute[75026]: WARNING nova.compute.manager [req-c8ad3eea-a32b-478b-96e8-3177a1e102bd req-0daac2e5-14c7-461e-b175-3b9e2da7749d service nova] [instance: a015e0b7-7ebd-407a-9bb5-697a0e5b8365] Received unexpected event network-vif-plugged-c88405f0-cfb1-4354-b3b0-d60c8e19867d for instance with vm_state deleted and task_state None.
Nov 10 19:19:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:54 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:54 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:19:54 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc9d19a-39c7-43da-a147-c5960ca576dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:19:54 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[09642cf5-ab4f-4080-b9fd-8642eaaf4d43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90] added
Nov 10 19:19:54 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d6869d-d971-4854-a01d-00e1abe58730]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bc7c21-eb3f-4d40-b33e-5325fcee49db]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ABdoyLvh {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ABdoyLvh" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c5d0d7-ef92-4cce-a534-8bc7bebc43d5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ABdoyLvh'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473812d-d5e7-47b2-912d-a7e83b1448d0]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:54 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e896619-d5bd-45a1-962c-5e3222810af1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:55 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:55 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c56a93-6bea-412a-9b2a-9ddbe1e026ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260]
Nov 10 19:19:55 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260] successful.
Nov 10 19:19:55 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ecbfa5-77b4-49a8-9e00-86bb85ffaa38]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[215fcde3-132e-416c-982e-bbb030a924e9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:55 user nova-compute[75026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:19:55 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:19:55 user nova-compute[75026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:19:55 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac96d66-b013-45e6-971f-1740141c7d98]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:19:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23166646637353565', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166646637353565', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG nova.objects.instance [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lazy-loading 'flavor' on Instance uuid 5ca3830d-1edf-4638-a5cf-6cf6efe37362 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:19:56 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:19:56 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:19:56 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:19:56 user nova-compute[75026]:   <serial>1df6ace3-5824-4d80-8bbc-e6802d7d9b90</serial>
Nov 10 19:19:56 user nova-compute[75026]: </disk>
Nov 10 19:19:56 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG nova.objects.instance [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lazy-loading 'flavor' on Instance uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] No VIF found with MAC fa:16:3e:4f:c1:db, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:56 user nova-compute[75026]: INFO nova.compute.manager [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Attaching volume 8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab to /dev/vdb
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.utils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe2369b-cfad-46e8-97df-e53c969046b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[567aaac2-a591-4a3e-95e2-8edce688709d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[54180b70-fc6f-4947-9812-76344577e405]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e967eeaa-85c5-43f0-b2f7-f7842ebd76a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-099e3b10-425f-4e32-a498-5ddf301abbeb tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.613s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:19:56 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:19:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbe9885-bf28-428b-b6fa-adb5c2bcf854]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG os_brick.utils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:56 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating existing volume attachment record: b79ca449-0db6-4b68-bf18-27866b22d80e {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG os_brick.utils [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a131a3-1592-48b8-a690-15797d68562c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf21918-c3c7-4f3d-a42c-3e3428f0e5de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0345f10e-7eb1-4eff-bc65-98653660f828]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed32aab4-f28e-4762-8917-4484285d242d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:19:57 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:19:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d16d2-599b-4d4c-b22e-8db799f862ff]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:19:57 user nova-compute[75026]: DEBUG os_brick.utils [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:19:57 user nova-compute[75026]: INFO nova.compute.manager [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Swapping volume 1df6ace3-5824-4d80-8bbc-e6802d7d9b90 for c98e1d59-365f-4ef5-bca7-159f38187ce8
Nov 10 19:19:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:19:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:03 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:20:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:20:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:20:04 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:20:04 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updating instance_info_cache with network_info: [{"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:20:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:20:05 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Waiting for libvirt event about the detach of device tapf9563120-80 with device alias net1 from instance 4fc47635-99d4-47a8-a482-022d75931831 is timed out.
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface> {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 10 19:20:05 user nova-compute[75026]:   <name>instance-00000007</name>
Nov 10 19:20:05 user nova-compute[75026]:   <uuid>4fc47635-99d4-47a8-a482-022d75931831</uuid>
Nov 10 19:20:05 user nova-compute[75026]:   <metadata>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:20:05 user nova-compute[75026]:   <nova:package version="0.0.0"/>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:name>tempest-device-tagging-server-1709409501</nova:name>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:creationTime>2023-11-10 19:18:47</nova:creationTime>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:flavor name="m1.tiny">
Nov 10 19:20:05 user nova-compute[75026]:     <nova:memory>512</nova:memory>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:disk>1</nova:disk>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:swap>0</nova:swap>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:vcpus>1</nova:vcpus>
Nov 10 19:20:05 user nova-compute[75026]:   </nova:flavor>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:owner>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:user uuid="a0eb014a1e2a42ce8f33dcf814421229">tempest-TaggedAttachmentsTest-617120050-project-member</nova:user>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:project uuid="32dc3afe879d475a96ad9312fec0c3e9">tempest-TaggedAttachmentsTest-617120050</nova:project>
Nov 10 19:20:05 user nova-compute[75026]:   </nova:owner>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:ports>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:port uuid="8f2f1337-bb4e-4cc0-892d-418b29969d56">
Nov 10 19:20:05 user nova-compute[75026]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:20:05 user nova-compute[75026]:     </nova:port>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:port uuid="f9563120-8021-4e77-9ce5-ab5cf8e39cf0">
Nov 10 19:20:05 user nova-compute[75026]:       <nova:ip type="fixed" address="10.10.10.133" ipVersion="4"/>
Nov 10 19:20:05 user nova-compute[75026]:     </nova:port>
Nov 10 19:20:05 user nova-compute[75026]:   </nova:ports>
Nov 10 19:20:05 user nova-compute[75026]: </nova:instance>
Nov 10 19:20:05 user nova-compute[75026]:   </metadata>
Nov 10 19:20:05 user nova-compute[75026]:   <memory unit='KiB'>524288</memory>
Nov 10 19:20:05 user nova-compute[75026]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 19:20:05 user nova-compute[75026]:   <vcpu placement='static'>1</vcpu>
Nov 10 19:20:05 user nova-compute[75026]:   <resource>
Nov 10 19:20:05 user nova-compute[75026]:     <partition>/machine</partition>
Nov 10 19:20:05 user nova-compute[75026]:   </resource>
Nov 10 19:20:05 user nova-compute[75026]:   <sysinfo type='smbios'>
Nov 10 19:20:05 user nova-compute[75026]:     <system>
Nov 10 19:20:05 user nova-compute[75026]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 19:20:05 user nova-compute[75026]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 19:20:05 user nova-compute[75026]:       <entry name='version'>0.0.0</entry>
Nov 10 19:20:05 user nova-compute[75026]:       <entry name='serial'>4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:20:05 user nova-compute[75026]:       <entry name='uuid'>4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:20:05 user nova-compute[75026]:       <entry name='family'>Virtual Machine</entry>
Nov 10 19:20:05 user nova-compute[75026]:     </system>
Nov 10 19:20:05 user nova-compute[75026]:   </sysinfo>
Nov 10 19:20:05 user nova-compute[75026]:   <os>
Nov 10 19:20:05 user nova-compute[75026]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 19:20:05 user nova-compute[75026]:     <boot dev='hd'/>
Nov 10 19:20:05 user nova-compute[75026]:     <smbios mode='sysinfo'/>
Nov 10 19:20:05 user nova-compute[75026]:   </os>
Nov 10 19:20:05 user nova-compute[75026]:   <features>
Nov 10 19:20:05 user nova-compute[75026]:     <acpi/>
Nov 10 19:20:05 user nova-compute[75026]:     <apic/>
Nov 10 19:20:05 user nova-compute[75026]:     <vmcoreinfo state='on'/>
Nov 10 19:20:05 user nova-compute[75026]:   </features>
Nov 10 19:20:05 user nova-compute[75026]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 19:20:05 user nova-compute[75026]:     <model fallback='forbid'>Nehalem</model>
Nov 10 19:20:05 user nova-compute[75026]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 19:20:05 user nova-compute[75026]:     <feature policy='require' name='vme'/>
Nov 10 19:20:05 user nova-compute[75026]:     <feature policy='require' name='x2apic'/>
Nov 10 19:20:05 user nova-compute[75026]:     <feature policy='require' name='hypervisor'/>
Nov 10 19:20:05 user nova-compute[75026]:   </cpu>
Nov 10 19:20:05 user nova-compute[75026]:   <clock offset='utc'>
Nov 10 19:20:05 user nova-compute[75026]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 19:20:05 user nova-compute[75026]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 19:20:05 user nova-compute[75026]:     <timer name='hpet' present='no'/>
Nov 10 19:20:05 user nova-compute[75026]:   </clock>
Nov 10 19:20:05 user nova-compute[75026]:   <on_poweroff>destroy</on_poweroff>
Nov 10 19:20:05 user nova-compute[75026]:   <on_reboot>restart</on_reboot>
Nov 10 19:20:05 user nova-compute[75026]:   <on_crash>destroy</on_crash>
Nov 10 19:20:05 user nova-compute[75026]:   <devices>
Nov 10 19:20:05 user nova-compute[75026]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 19:20:05 user nova-compute[75026]:     <disk type='file' device='disk'>
Nov 10 19:20:05 user nova-compute[75026]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 19:20:05 user nova-compute[75026]:       <source file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk' index='2'/>
Nov 10 19:20:05 user nova-compute[75026]:       <backingStore type='file' index='3'>
Nov 10 19:20:05 user nova-compute[75026]:         <format type='raw'/>
Nov 10 19:20:05 user nova-compute[75026]:         <source file='/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd'/>
Nov 10 19:20:05 user nova-compute[75026]:         <backingStore/>
Nov 10 19:20:05 user nova-compute[75026]:       </backingStore>
Nov 10 19:20:05 user nova-compute[75026]:       <target dev='vda' bus='virtio'/>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='virtio-disk0'/>
Nov 10 19:20:05 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </disk>
Nov 10 19:20:05 user nova-compute[75026]:     <disk type='file' device='cdrom'>
Nov 10 19:20:05 user nova-compute[75026]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 19:20:05 user nova-compute[75026]:       <source file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.config' index='1'/>
Nov 10 19:20:05 user nova-compute[75026]:       <backingStore/>
Nov 10 19:20:05 user nova-compute[75026]:       <target dev='hda' bus='ide'/>
Nov 10 19:20:05 user nova-compute[75026]:       <readonly/>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='ide0-0-0'/>
Nov 10 19:20:05 user nova-compute[75026]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </disk>
Nov 10 19:20:05 user nova-compute[75026]:     <controller type='usb' index='0' model='none'>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='usb'/>
Nov 10 19:20:05 user nova-compute[75026]:     </controller>
Nov 10 19:20:05 user nova-compute[75026]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='pci.0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </controller>
Nov 10 19:20:05 user nova-compute[75026]:     <controller type='ide' index='0'>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='ide'/>
Nov 10 19:20:05 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 19:20:05 user nova-compute[75026]:     </controller>
Nov 10 19:20:05 user nova-compute[75026]:     <interface type='ethernet'>
Nov 10 19:20:05 user nova-compute[75026]:       <mac address='fa:16:3e:49:9d:60'/>
Nov 10 19:20:05 user nova-compute[75026]:       <target dev='tap8f2f1337-bb'/>
Nov 10 19:20:05 user nova-compute[75026]:       <model type='virtio'/>
Nov 10 19:20:05 user nova-compute[75026]:       <mtu size='1442'/>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='net0'/>
Nov 10 19:20:05 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </interface>
Nov 10 19:20:05 user nova-compute[75026]:     <serial type='pty'>
Nov 10 19:20:05 user nova-compute[75026]:       <source path='/dev/pts/6'/>
Nov 10 19:20:05 user nova-compute[75026]:       <log file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log' append='off'/>
Nov 10 19:20:05 user nova-compute[75026]:       <target type='isa-serial' port='0'>
Nov 10 19:20:05 user nova-compute[75026]:         <model name='isa-serial'/>
Nov 10 19:20:05 user nova-compute[75026]:       </target>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='serial0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </serial>
Nov 10 19:20:05 user nova-compute[75026]:     <console type='pty' tty='/dev/pts/6'>
Nov 10 19:20:05 user nova-compute[75026]:       <source path='/dev/pts/6'/>
Nov 10 19:20:05 user nova-compute[75026]:       <log file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log' append='off'/>
Nov 10 19:20:05 user nova-compute[75026]:       <target type='serial' port='0'/>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='serial0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </console>
Nov 10 19:20:05 user nova-compute[75026]:     <input type='mouse' bus='ps2'>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='input0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </input>
Nov 10 19:20:05 user nova-compute[75026]:     <input type='keyboard' bus='ps2'>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='input1'/>
Nov 10 19:20:05 user nova-compute[75026]:     </input>
Nov 10 19:20:05 user nova-compute[75026]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 10 19:20:05 user nova-compute[75026]:       <listen type='address' address='0.0.0.0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </graphics>
Nov 10 19:20:05 user nova-compute[75026]:     <audio id='1' type='none'/>
Nov 10 19:20:05 user nova-compute[75026]:     <video>
Nov 10 19:20:05 user nova-compute[75026]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='video0'/>
Nov 10 19:20:05 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </video>
Nov 10 19:20:05 user nova-compute[75026]:     <memballoon model='virtio'>
Nov 10 19:20:05 user nova-compute[75026]:       <stats period='10'/>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='balloon0'/>
Nov 10 19:20:05 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </memballoon>
Nov 10 19:20:05 user nova-compute[75026]:     <rng model='virtio'>
Nov 10 19:20:05 user nova-compute[75026]:       <backend model='random'>/dev/urandom</backend>
Nov 10 19:20:05 user nova-compute[75026]:       <alias name='rng0'/>
Nov 10 19:20:05 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 19:20:05 user nova-compute[75026]:     </rng>
Nov 10 19:20:05 user nova-compute[75026]:   </devices>
Nov 10 19:20:05 user nova-compute[75026]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 19:20:05 user nova-compute[75026]:     <label>libvirt-4fc47635-99d4-47a8-a482-022d75931831</label>
Nov 10 19:20:05 user nova-compute[75026]:     <imagelabel>libvirt-4fc47635-99d4-47a8-a482-022d75931831</imagelabel>
Nov 10 19:20:05 user nova-compute[75026]:   </seclabel>
Nov 10 19:20:05 user nova-compute[75026]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 19:20:05 user nova-compute[75026]:     <label>+64055:+108</label>
Nov 10 19:20:05 user nova-compute[75026]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 19:20:05 user nova-compute[75026]:   </seclabel>
Nov 10 19:20:05 user nova-compute[75026]: </domain>
Nov 10 19:20:05 user nova-compute[75026]:  {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 19:20:05 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Successfully detached device tapf9563120-80 from instance 4fc47635-99d4-47a8-a482-022d75931831 from the live domain config.
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converting VIF {"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG os_vif [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9563120-80, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9368aaa4-11b4-40a0-ad93-0ba58e6abb9a) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:05 user nova-compute[75026]: INFO os_vif [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80')
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:20:05 user nova-compute[75026]:   <nova:package version="0.0.0"/>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:name>tempest-device-tagging-server-1709409501</nova:name>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:creationTime>2023-11-10 19:20:05</nova:creationTime>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:flavor name="m1.tiny">
Nov 10 19:20:05 user nova-compute[75026]:     <nova:memory>512</nova:memory>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:disk>1</nova:disk>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:swap>0</nova:swap>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:vcpus>1</nova:vcpus>
Nov 10 19:20:05 user nova-compute[75026]:   </nova:flavor>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:owner>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:user uuid="a0eb014a1e2a42ce8f33dcf814421229">tempest-TaggedAttachmentsTest-617120050-project-member</nova:user>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:project uuid="32dc3afe879d475a96ad9312fec0c3e9">tempest-TaggedAttachmentsTest-617120050</nova:project>
Nov 10 19:20:05 user nova-compute[75026]:   </nova:owner>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:20:05 user nova-compute[75026]:   <nova:ports>
Nov 10 19:20:05 user nova-compute[75026]:     <nova:port uuid="8f2f1337-bb4e-4cc0-892d-418b29969d56">
Nov 10 19:20:05 user nova-compute[75026]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:20:05 user nova-compute[75026]:     </nova:port>
Nov 10 19:20:05 user nova-compute[75026]:   </nova:ports>
Nov 10 19:20:05 user nova-compute[75026]: </nova:instance>
Nov 10 19:20:05 user nova-compute[75026]:  {{(pid=75026) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-deleted-f9563120-8021-4e77-9ce5-ab5cf8e39cf0 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:06 user nova-compute[75026]: INFO nova.compute.manager [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Neutron deleted interface f9563120-8021-4e77-9ce5-ab5cf8e39cf0; detaching it from the instance and deleting it from the info cache
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.network.neutron [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating instance_info_cache with network_info: [{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquired lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.objects.instance [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Lazy-loading 'system_metadata' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.objects.instance [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Lazy-loading 'flavor' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.objects.base [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Object Instance<4fc47635-99d4-47a8-a482-022d75931831> lazy-loaded attributes: system_metadata,flavor {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Converting VIF {"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface> {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 10 19:20:06 user nova-compute[75026]:   <name>instance-00000007</name>
Nov 10 19:20:06 user nova-compute[75026]:   <uuid>4fc47635-99d4-47a8-a482-022d75931831</uuid>
Nov 10 19:20:06 user nova-compute[75026]:   <metadata>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:20:06 user nova-compute[75026]:   <nova:package version="0.0.0"/>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:name>tempest-device-tagging-server-1709409501</nova:name>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:creationTime>2023-11-10 19:20:05</nova:creationTime>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:flavor name="m1.tiny">
Nov 10 19:20:06 user nova-compute[75026]:     <nova:memory>512</nova:memory>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:disk>1</nova:disk>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:swap>0</nova:swap>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:vcpus>1</nova:vcpus>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:flavor>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:owner>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:user uuid="a0eb014a1e2a42ce8f33dcf814421229">tempest-TaggedAttachmentsTest-617120050-project-member</nova:user>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:project uuid="32dc3afe879d475a96ad9312fec0c3e9">tempest-TaggedAttachmentsTest-617120050</nova:project>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:owner>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:ports>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:port uuid="8f2f1337-bb4e-4cc0-892d-418b29969d56">
Nov 10 19:20:06 user nova-compute[75026]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:20:06 user nova-compute[75026]:     </nova:port>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:ports>
Nov 10 19:20:06 user nova-compute[75026]: </nova:instance>
Nov 10 19:20:06 user nova-compute[75026]:   </metadata>
Nov 10 19:20:06 user nova-compute[75026]:   <memory unit='KiB'>524288</memory>
Nov 10 19:20:06 user nova-compute[75026]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 19:20:06 user nova-compute[75026]:   <vcpu placement='static'>1</vcpu>
Nov 10 19:20:06 user nova-compute[75026]:   <resource>
Nov 10 19:20:06 user nova-compute[75026]:     <partition>/machine</partition>
Nov 10 19:20:06 user nova-compute[75026]:   </resource>
Nov 10 19:20:06 user nova-compute[75026]:   <sysinfo type='smbios'>
Nov 10 19:20:06 user nova-compute[75026]:     <system>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='version'>0.0.0</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='serial'>4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='uuid'>4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='family'>Virtual Machine</entry>
Nov 10 19:20:06 user nova-compute[75026]:     </system>
Nov 10 19:20:06 user nova-compute[75026]:   </sysinfo>
Nov 10 19:20:06 user nova-compute[75026]:   <os>
Nov 10 19:20:06 user nova-compute[75026]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 19:20:06 user nova-compute[75026]:     <boot dev='hd'/>
Nov 10 19:20:06 user nova-compute[75026]:     <smbios mode='sysinfo'/>
Nov 10 19:20:06 user nova-compute[75026]:   </os>
Nov 10 19:20:06 user nova-compute[75026]:   <features>
Nov 10 19:20:06 user nova-compute[75026]:     <acpi/>
Nov 10 19:20:06 user nova-compute[75026]:     <apic/>
Nov 10 19:20:06 user nova-compute[75026]:     <vmcoreinfo state='on'/>
Nov 10 19:20:06 user nova-compute[75026]:   </features>
Nov 10 19:20:06 user nova-compute[75026]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 19:20:06 user nova-compute[75026]:     <model fallback='forbid'>Nehalem</model>
Nov 10 19:20:06 user nova-compute[75026]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 19:20:06 user nova-compute[75026]:     <feature policy='require' name='vme'/>
Nov 10 19:20:06 user nova-compute[75026]:     <feature policy='require' name='x2apic'/>
Nov 10 19:20:06 user nova-compute[75026]:     <feature policy='require' name='hypervisor'/>
Nov 10 19:20:06 user nova-compute[75026]:   </cpu>
Nov 10 19:20:06 user nova-compute[75026]:   <clock offset='utc'>
Nov 10 19:20:06 user nova-compute[75026]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 19:20:06 user nova-compute[75026]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 19:20:06 user nova-compute[75026]:     <timer name='hpet' present='no'/>
Nov 10 19:20:06 user nova-compute[75026]:   </clock>
Nov 10 19:20:06 user nova-compute[75026]:   <on_poweroff>destroy</on_poweroff>
Nov 10 19:20:06 user nova-compute[75026]:   <on_reboot>restart</on_reboot>
Nov 10 19:20:06 user nova-compute[75026]:   <on_crash>destroy</on_crash>
Nov 10 19:20:06 user nova-compute[75026]:   <devices>
Nov 10 19:20:06 user nova-compute[75026]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 19:20:06 user nova-compute[75026]:     <disk type='file' device='disk'>
Nov 10 19:20:06 user nova-compute[75026]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 19:20:06 user nova-compute[75026]:       <source file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk' index='2'/>
Nov 10 19:20:06 user nova-compute[75026]:       <backingStore type='file' index='3'>
Nov 10 19:20:06 user nova-compute[75026]:         <format type='raw'/>
Nov 10 19:20:06 user nova-compute[75026]:         <source file='/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd'/>
Nov 10 19:20:06 user nova-compute[75026]:         <backingStore/>
Nov 10 19:20:06 user nova-compute[75026]:       </backingStore>
Nov 10 19:20:06 user nova-compute[75026]:       <target dev='vda' bus='virtio'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='virtio-disk0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </disk>
Nov 10 19:20:06 user nova-compute[75026]:     <disk type='file' device='cdrom'>
Nov 10 19:20:06 user nova-compute[75026]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 19:20:06 user nova-compute[75026]:       <source file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.config' index='1'/>
Nov 10 19:20:06 user nova-compute[75026]:       <backingStore/>
Nov 10 19:20:06 user nova-compute[75026]:       <target dev='hda' bus='ide'/>
Nov 10 19:20:06 user nova-compute[75026]:       <readonly/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='ide0-0-0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </disk>
Nov 10 19:20:06 user nova-compute[75026]:     <controller type='usb' index='0' model='none'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='usb'/>
Nov 10 19:20:06 user nova-compute[75026]:     </controller>
Nov 10 19:20:06 user nova-compute[75026]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='pci.0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </controller>
Nov 10 19:20:06 user nova-compute[75026]:     <controller type='ide' index='0'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='ide'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 19:20:06 user nova-compute[75026]:     </controller>
Nov 10 19:20:06 user nova-compute[75026]:     <interface type='ethernet'>
Nov 10 19:20:06 user nova-compute[75026]:       <mac address='fa:16:3e:49:9d:60'/>
Nov 10 19:20:06 user nova-compute[75026]:       <target dev='tap8f2f1337-bb'/>
Nov 10 19:20:06 user nova-compute[75026]:       <model type='virtio'/>
Nov 10 19:20:06 user nova-compute[75026]:       <mtu size='1442'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='net0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </interface>
Nov 10 19:20:06 user nova-compute[75026]:     <serial type='pty'>
Nov 10 19:20:06 user nova-compute[75026]:       <source path='/dev/pts/6'/>
Nov 10 19:20:06 user nova-compute[75026]:       <log file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log' append='off'/>
Nov 10 19:20:06 user nova-compute[75026]:       <target type='isa-serial' port='0'>
Nov 10 19:20:06 user nova-compute[75026]:         <model name='isa-serial'/>
Nov 10 19:20:06 user nova-compute[75026]:       </target>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='serial0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </serial>
Nov 10 19:20:06 user nova-compute[75026]:     <console type='pty' tty='/dev/pts/6'>
Nov 10 19:20:06 user nova-compute[75026]:       <source path='/dev/pts/6'/>
Nov 10 19:20:06 user nova-compute[75026]:       <log file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log' append='off'/>
Nov 10 19:20:06 user nova-compute[75026]:       <target type='serial' port='0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='serial0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </console>
Nov 10 19:20:06 user nova-compute[75026]:     <input type='mouse' bus='ps2'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='input0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </input>
Nov 10 19:20:06 user nova-compute[75026]:     <input type='keyboard' bus='ps2'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='input1'/>
Nov 10 19:20:06 user nova-compute[75026]:     </input>
Nov 10 19:20:06 user nova-compute[75026]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 10 19:20:06 user nova-compute[75026]:       <listen type='address' address='0.0.0.0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </graphics>
Nov 10 19:20:06 user nova-compute[75026]:     <audio id='1' type='none'/>
Nov 10 19:20:06 user nova-compute[75026]:     <video>
Nov 10 19:20:06 user nova-compute[75026]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='video0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </video>
Nov 10 19:20:06 user nova-compute[75026]:     <memballoon model='virtio'>
Nov 10 19:20:06 user nova-compute[75026]:       <stats period='10'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='balloon0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </memballoon>
Nov 10 19:20:06 user nova-compute[75026]:     <rng model='virtio'>
Nov 10 19:20:06 user nova-compute[75026]:       <backend model='random'>/dev/urandom</backend>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='rng0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </rng>
Nov 10 19:20:06 user nova-compute[75026]:   </devices>
Nov 10 19:20:06 user nova-compute[75026]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 19:20:06 user nova-compute[75026]:     <label>libvirt-4fc47635-99d4-47a8-a482-022d75931831</label>
Nov 10 19:20:06 user nova-compute[75026]:     <imagelabel>libvirt-4fc47635-99d4-47a8-a482-022d75931831</imagelabel>
Nov 10 19:20:06 user nova-compute[75026]:   </seclabel>
Nov 10 19:20:06 user nova-compute[75026]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 19:20:06 user nova-compute[75026]:     <label>+64055:+108</label>
Nov 10 19:20:06 user nova-compute[75026]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 19:20:06 user nova-compute[75026]:   </seclabel>
Nov 10 19:20:06 user nova-compute[75026]: </domain>
Nov 10 19:20:06 user nova-compute[75026]:  {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface> {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:86:50:d4"/><model type="virtio"/><mtu size="1442"/><target dev="tapf9563120-80"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 10 19:20:06 user nova-compute[75026]:   <name>instance-00000007</name>
Nov 10 19:20:06 user nova-compute[75026]:   <uuid>4fc47635-99d4-47a8-a482-022d75931831</uuid>
Nov 10 19:20:06 user nova-compute[75026]:   <metadata>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:20:06 user nova-compute[75026]:   <nova:package version="0.0.0"/>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:name>tempest-device-tagging-server-1709409501</nova:name>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:creationTime>2023-11-10 19:20:05</nova:creationTime>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:flavor name="m1.tiny">
Nov 10 19:20:06 user nova-compute[75026]:     <nova:memory>512</nova:memory>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:disk>1</nova:disk>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:swap>0</nova:swap>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:vcpus>1</nova:vcpus>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:flavor>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:owner>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:user uuid="a0eb014a1e2a42ce8f33dcf814421229">tempest-TaggedAttachmentsTest-617120050-project-member</nova:user>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:project uuid="32dc3afe879d475a96ad9312fec0c3e9">tempest-TaggedAttachmentsTest-617120050</nova:project>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:owner>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:ports>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:port uuid="8f2f1337-bb4e-4cc0-892d-418b29969d56">
Nov 10 19:20:06 user nova-compute[75026]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:20:06 user nova-compute[75026]:     </nova:port>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:ports>
Nov 10 19:20:06 user nova-compute[75026]: </nova:instance>
Nov 10 19:20:06 user nova-compute[75026]:   </metadata>
Nov 10 19:20:06 user nova-compute[75026]:   <memory unit='KiB'>524288</memory>
Nov 10 19:20:06 user nova-compute[75026]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 19:20:06 user nova-compute[75026]:   <vcpu placement='static'>1</vcpu>
Nov 10 19:20:06 user nova-compute[75026]:   <resource>
Nov 10 19:20:06 user nova-compute[75026]:     <partition>/machine</partition>
Nov 10 19:20:06 user nova-compute[75026]:   </resource>
Nov 10 19:20:06 user nova-compute[75026]:   <sysinfo type='smbios'>
Nov 10 19:20:06 user nova-compute[75026]:     <system>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='version'>0.0.0</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='serial'>4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='uuid'>4fc47635-99d4-47a8-a482-022d75931831</entry>
Nov 10 19:20:06 user nova-compute[75026]:       <entry name='family'>Virtual Machine</entry>
Nov 10 19:20:06 user nova-compute[75026]:     </system>
Nov 10 19:20:06 user nova-compute[75026]:   </sysinfo>
Nov 10 19:20:06 user nova-compute[75026]:   <os>
Nov 10 19:20:06 user nova-compute[75026]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 19:20:06 user nova-compute[75026]:     <boot dev='hd'/>
Nov 10 19:20:06 user nova-compute[75026]:     <smbios mode='sysinfo'/>
Nov 10 19:20:06 user nova-compute[75026]:   </os>
Nov 10 19:20:06 user nova-compute[75026]:   <features>
Nov 10 19:20:06 user nova-compute[75026]:     <acpi/>
Nov 10 19:20:06 user nova-compute[75026]:     <apic/>
Nov 10 19:20:06 user nova-compute[75026]:     <vmcoreinfo state='on'/>
Nov 10 19:20:06 user nova-compute[75026]:   </features>
Nov 10 19:20:06 user nova-compute[75026]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 19:20:06 user nova-compute[75026]:     <model fallback='forbid'>Nehalem</model>
Nov 10 19:20:06 user nova-compute[75026]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 19:20:06 user nova-compute[75026]:     <feature policy='require' name='vme'/>
Nov 10 19:20:06 user nova-compute[75026]:     <feature policy='require' name='x2apic'/>
Nov 10 19:20:06 user nova-compute[75026]:     <feature policy='require' name='hypervisor'/>
Nov 10 19:20:06 user nova-compute[75026]:   </cpu>
Nov 10 19:20:06 user nova-compute[75026]:   <clock offset='utc'>
Nov 10 19:20:06 user nova-compute[75026]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 19:20:06 user nova-compute[75026]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 19:20:06 user nova-compute[75026]:     <timer name='hpet' present='no'/>
Nov 10 19:20:06 user nova-compute[75026]:   </clock>
Nov 10 19:20:06 user nova-compute[75026]:   <on_poweroff>destroy</on_poweroff>
Nov 10 19:20:06 user nova-compute[75026]:   <on_reboot>restart</on_reboot>
Nov 10 19:20:06 user nova-compute[75026]:   <on_crash>destroy</on_crash>
Nov 10 19:20:06 user nova-compute[75026]:   <devices>
Nov 10 19:20:06 user nova-compute[75026]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 19:20:06 user nova-compute[75026]:     <disk type='file' device='disk'>
Nov 10 19:20:06 user nova-compute[75026]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 19:20:06 user nova-compute[75026]:       <source file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk' index='2'/>
Nov 10 19:20:06 user nova-compute[75026]:       <backingStore type='file' index='3'>
Nov 10 19:20:06 user nova-compute[75026]:         <format type='raw'/>
Nov 10 19:20:06 user nova-compute[75026]:         <source file='/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd'/>
Nov 10 19:20:06 user nova-compute[75026]:         <backingStore/>
Nov 10 19:20:06 user nova-compute[75026]:       </backingStore>
Nov 10 19:20:06 user nova-compute[75026]:       <target dev='vda' bus='virtio'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='virtio-disk0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </disk>
Nov 10 19:20:06 user nova-compute[75026]:     <disk type='file' device='cdrom'>
Nov 10 19:20:06 user nova-compute[75026]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 19:20:06 user nova-compute[75026]:       <source file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/disk.config' index='1'/>
Nov 10 19:20:06 user nova-compute[75026]:       <backingStore/>
Nov 10 19:20:06 user nova-compute[75026]:       <target dev='hda' bus='ide'/>
Nov 10 19:20:06 user nova-compute[75026]:       <readonly/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='ide0-0-0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </disk>
Nov 10 19:20:06 user nova-compute[75026]:     <controller type='usb' index='0' model='none'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='usb'/>
Nov 10 19:20:06 user nova-compute[75026]:     </controller>
Nov 10 19:20:06 user nova-compute[75026]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='pci.0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </controller>
Nov 10 19:20:06 user nova-compute[75026]:     <controller type='ide' index='0'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='ide'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 19:20:06 user nova-compute[75026]:     </controller>
Nov 10 19:20:06 user nova-compute[75026]:     <interface type='ethernet'>
Nov 10 19:20:06 user nova-compute[75026]:       <mac address='fa:16:3e:49:9d:60'/>
Nov 10 19:20:06 user nova-compute[75026]:       <target dev='tap8f2f1337-bb'/>
Nov 10 19:20:06 user nova-compute[75026]:       <model type='virtio'/>
Nov 10 19:20:06 user nova-compute[75026]:       <mtu size='1442'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='net0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </interface>
Nov 10 19:20:06 user nova-compute[75026]:     <serial type='pty'>
Nov 10 19:20:06 user nova-compute[75026]:       <source path='/dev/pts/6'/>
Nov 10 19:20:06 user nova-compute[75026]:       <log file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log' append='off'/>
Nov 10 19:20:06 user nova-compute[75026]:       <target type='isa-serial' port='0'>
Nov 10 19:20:06 user nova-compute[75026]:         <model name='isa-serial'/>
Nov 10 19:20:06 user nova-compute[75026]:       </target>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='serial0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </serial>
Nov 10 19:20:06 user nova-compute[75026]:     <console type='pty' tty='/dev/pts/6'>
Nov 10 19:20:06 user nova-compute[75026]:       <source path='/dev/pts/6'/>
Nov 10 19:20:06 user nova-compute[75026]:       <log file='/opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831/console.log' append='off'/>
Nov 10 19:20:06 user nova-compute[75026]:       <target type='serial' port='0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='serial0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </console>
Nov 10 19:20:06 user nova-compute[75026]:     <input type='mouse' bus='ps2'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='input0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </input>
Nov 10 19:20:06 user nova-compute[75026]:     <input type='keyboard' bus='ps2'>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='input1'/>
Nov 10 19:20:06 user nova-compute[75026]:     </input>
Nov 10 19:20:06 user nova-compute[75026]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 10 19:20:06 user nova-compute[75026]:       <listen type='address' address='0.0.0.0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </graphics>
Nov 10 19:20:06 user nova-compute[75026]:     <audio id='1' type='none'/>
Nov 10 19:20:06 user nova-compute[75026]:     <video>
Nov 10 19:20:06 user nova-compute[75026]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='video0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </video>
Nov 10 19:20:06 user nova-compute[75026]:     <memballoon model='virtio'>
Nov 10 19:20:06 user nova-compute[75026]:       <stats period='10'/>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='balloon0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </memballoon>
Nov 10 19:20:06 user nova-compute[75026]:     <rng model='virtio'>
Nov 10 19:20:06 user nova-compute[75026]:       <backend model='random'>/dev/urandom</backend>
Nov 10 19:20:06 user nova-compute[75026]:       <alias name='rng0'/>
Nov 10 19:20:06 user nova-compute[75026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 19:20:06 user nova-compute[75026]:     </rng>
Nov 10 19:20:06 user nova-compute[75026]:   </devices>
Nov 10 19:20:06 user nova-compute[75026]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 19:20:06 user nova-compute[75026]:     <label>libvirt-4fc47635-99d4-47a8-a482-022d75931831</label>
Nov 10 19:20:06 user nova-compute[75026]:     <imagelabel>libvirt-4fc47635-99d4-47a8-a482-022d75931831</imagelabel>
Nov 10 19:20:06 user nova-compute[75026]:   </seclabel>
Nov 10 19:20:06 user nova-compute[75026]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 19:20:06 user nova-compute[75026]:     <label>+64055:+108</label>
Nov 10 19:20:06 user nova-compute[75026]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 19:20:06 user nova-compute[75026]:   </seclabel>
Nov 10 19:20:06 user nova-compute[75026]: </domain>
Nov 10 19:20:06 user nova-compute[75026]:  {{(pid=75026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 19:20:06 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Detaching interface fa:16:3e:86:50:d4 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf9563120-80' not found.
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Converting VIF {"id": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "address": "fa:16:3e:86:50:d4", "network": {"id": "b126b120-b133-4d2e-b6af-c79e865879bf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-581455069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9563120-80", "ovs_interfaceid": "f9563120-8021-4e77-9ce5-ab5cf8e39cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG os_vif [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9563120-80, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:20:06 user nova-compute[75026]: INFO os_vif [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:50:d4,bridge_name='br-int',has_traffic_filtering=True,id=f9563120-8021-4e77-9ce5-ab5cf8e39cf0,network=Network(b126b120-b133-4d2e-b6af-c79e865879bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9563120-80')
Nov 10 19:20:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [req-f581549e-a82a-4bb8-8155-f458a1608a41 req-b0731525-b6b7-45b9-bb3b-93b4748444b6 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:20:06 user nova-compute[75026]:   <nova:package version="0.0.0"/>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:name>tempest-device-tagging-server-1709409501</nova:name>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:creationTime>2023-11-10 19:20:06</nova:creationTime>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:flavor name="m1.tiny">
Nov 10 19:20:06 user nova-compute[75026]:     <nova:memory>512</nova:memory>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:disk>1</nova:disk>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:swap>0</nova:swap>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:vcpus>1</nova:vcpus>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:flavor>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:owner>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:user uuid="a0eb014a1e2a42ce8f33dcf814421229">tempest-TaggedAttachmentsTest-617120050-project-member</nova:user>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:project uuid="32dc3afe879d475a96ad9312fec0c3e9">tempest-TaggedAttachmentsTest-617120050</nova:project>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:owner>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:20:06 user nova-compute[75026]:   <nova:ports>
Nov 10 19:20:06 user nova-compute[75026]:     <nova:port uuid="8f2f1337-bb4e-4cc0-892d-418b29969d56">
Nov 10 19:20:06 user nova-compute[75026]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:20:06 user nova-compute[75026]:     </nova:port>
Nov 10 19:20:06 user nova-compute[75026]:   </nova:ports>
Nov 10 19:20:06 user nova-compute[75026]: </nova:instance>
Nov 10 19:20:06 user nova-compute[75026]:  {{(pid=75026) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating instance_info_cache with network_info: [{"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Releasing lock "refresh_cache-4fc47635-99d4-47a8-a482-022d75931831" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-19acd159-ba7d-4470-b5ff-9b18b7cc06fc tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "interface-4fc47635-99d4-47a8-a482-022d75931831-f9563120-8021-4e77-9ce5-ab5cf8e39cf0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.577s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.373s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:20:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:20:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.652050018310547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance d57c5ada-750c-41af-a14c-6546374cf5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 09a67456-da2f-4478-8c9a-6cac0e505134 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4fc47635-99d4-47a8-a482-022d75931831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f86437d3-8401-4c25-8122-1dcb98c1cd19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:20:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:20:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:20:11 user nova-compute[75026]: INFO nova.compute.claims [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Claim successful on node user
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.network.neutron [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:20:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:20:11 user nova-compute[75026]: DEBUG nova.policy [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2f78c518af14d6e84894f850811426b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89956906ad1943408b1783771ee6aa32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:20:12 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Creating image(s)
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "/opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "/opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "/opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.239s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.010s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.243s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG nova.network.neutron [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Successfully created port: 90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk 1073741824" returned: 0 in 0.059s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.236s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:20:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Cannot resize image /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Ensure instance console log exists: /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:13 user nova-compute[75026]: INFO nova.compute.manager [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Terminating instance
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Successfully updated port: 90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "refresh_cache-e220bb5d-26bb-4939-a635-ba5d946e7657" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquired lock "refresh_cache-e220bb5d-26bb-4939-a635-ba5d946e7657" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-c41bc523-5a94-4a46-8c60-2bc701671b6e req-ac30f472-9e0e-4508-a8f8-50fc6b195300 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-changed-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-c41bc523-5a94-4a46-8c60-2bc701671b6e req-ac30f472-9e0e-4508-a8f8-50fc6b195300 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Refreshing instance network info cache due to event network-changed-90fe5a1f-83fe-41eb-8576-77be36d51234. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c41bc523-5a94-4a46-8c60-2bc701671b6e req-ac30f472-9e0e-4508-a8f8-50fc6b195300 service nova] Acquiring lock "refresh_cache-e220bb5d-26bb-4939-a635-ba5d946e7657" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-de840ee2-94ff-4fb6-b6d7-c84ee6b40770 req-631ebe35-0fbb-40e9-abd5-fd4c8a7f5178 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received event network-vif-unplugged-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-de840ee2-94ff-4fb6-b6d7-c84ee6b40770 req-631ebe35-0fbb-40e9-abd5-fd4c8a7f5178 service nova] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-de840ee2-94ff-4fb6-b6d7-c84ee6b40770 req-631ebe35-0fbb-40e9-abd5-fd4c8a7f5178 service nova] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-de840ee2-94ff-4fb6-b6d7-c84ee6b40770 req-631ebe35-0fbb-40e9-abd5-fd4c8a7f5178 service nova] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-de840ee2-94ff-4fb6-b6d7-c84ee6b40770 req-631ebe35-0fbb-40e9-abd5-fd4c8a7f5178 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] No waiting events found dispatching network-vif-unplugged-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-de840ee2-94ff-4fb6-b6d7-c84ee6b40770 req-631ebe35-0fbb-40e9-abd5-fd4c8a7f5178 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received event network-vif-unplugged-e362b1aa-9251-4e43-b3af-3c825324f644 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Updating instance_info_cache with network_info: [{"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Releasing lock "refresh_cache-e220bb5d-26bb-4939-a635-ba5d946e7657" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Instance network_info: |[{"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c41bc523-5a94-4a46-8c60-2bc701671b6e req-ac30f472-9e0e-4508-a8f8-50fc6b195300 service nova] Acquired lock "refresh_cache-e220bb5d-26bb-4939-a635-ba5d946e7657" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.network.neutron [req-c41bc523-5a94-4a46-8c60-2bc701671b6e req-ac30f472-9e0e-4508-a8f8-50fc6b195300 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Refreshing network info cache for port 90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Start _get_guest_xml network_info=[{"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:20:13 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:20:13 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-132465',display_name='tempest-VolumesAdminNegativeTest-server-132465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-132465',id=13,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89956906ad1943408b1783771ee6aa32',ramdisk_id='',reservation_id='r-c1k407yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1994864820',owner_user_name='tempest-VolumesAdminNegativeTest-1994864820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:20:12Z,user_data=None,user_id='f2f78c518af14d6e84894f850811426b',uuid=e220bb5d-26bb-4939-a635-ba5d946e7657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converting VIF {"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:28:b1,bridge_name='br-int',has_traffic_filtering=True,id=90fe5a1f-83fe-41eb-8576-77be36d51234,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fe5a1f-83') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:13 user nova-compute[75026]: DEBUG nova.objects.instance [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lazy-loading 'pci_devices' on Instance uuid e220bb5d-26bb-4939-a635-ba5d946e7657 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:20:14 user nova-compute[75026]:   <uuid>e220bb5d-26bb-4939-a635-ba5d946e7657</uuid>
Nov 10 19:20:14 user nova-compute[75026]:   <name>instance-0000000d</name>
Nov 10 19:20:14 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:20:14 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:20:14 user nova-compute[75026]:   <metadata>
Nov 10 19:20:14 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:20:14 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:20:14 user nova-compute[75026]:       <nova:name>tempest-VolumesAdminNegativeTest-server-132465</nova:name>
Nov 10 19:20:14 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:20:13</nova:creationTime>
Nov 10 19:20:14 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:20:14 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:20:14 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:20:14 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:20:14 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:20:14 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:20:14 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:20:14 user nova-compute[75026]:       <nova:owner>
Nov 10 19:20:14 user nova-compute[75026]:         <nova:user uuid="f2f78c518af14d6e84894f850811426b">tempest-VolumesAdminNegativeTest-1994864820-project-member</nova:user>
Nov 10 19:20:14 user nova-compute[75026]:         <nova:project uuid="89956906ad1943408b1783771ee6aa32">tempest-VolumesAdminNegativeTest-1994864820</nova:project>
Nov 10 19:20:14 user nova-compute[75026]:       </nova:owner>
Nov 10 19:20:14 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:20:14 user nova-compute[75026]:       <nova:ports>
Nov 10 19:20:14 user nova-compute[75026]:         <nova:port uuid="90fe5a1f-83fe-41eb-8576-77be36d51234">
Nov 10 19:20:14 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:20:14 user nova-compute[75026]:         </nova:port>
Nov 10 19:20:14 user nova-compute[75026]:       </nova:ports>
Nov 10 19:20:14 user nova-compute[75026]:     </nova:instance>
Nov 10 19:20:14 user nova-compute[75026]:   </metadata>
Nov 10 19:20:14 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:20:14 user nova-compute[75026]:     <system>
Nov 10 19:20:14 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:20:14 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:20:14 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:20:14 user nova-compute[75026]:       <entry name="serial">e220bb5d-26bb-4939-a635-ba5d946e7657</entry>
Nov 10 19:20:14 user nova-compute[75026]:       <entry name="uuid">e220bb5d-26bb-4939-a635-ba5d946e7657</entry>
Nov 10 19:20:14 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:20:14 user nova-compute[75026]:     </system>
Nov 10 19:20:14 user nova-compute[75026]:   </sysinfo>
Nov 10 19:20:14 user nova-compute[75026]:   <os>
Nov 10 19:20:14 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:20:14 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:20:14 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:20:14 user nova-compute[75026]:   </os>
Nov 10 19:20:14 user nova-compute[75026]:   <features>
Nov 10 19:20:14 user nova-compute[75026]:     <acpi/>
Nov 10 19:20:14 user nova-compute[75026]:     <apic/>
Nov 10 19:20:14 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:20:14 user nova-compute[75026]:   </features>
Nov 10 19:20:14 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:20:14 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:20:14 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:20:14 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:20:14 user nova-compute[75026]:   </clock>
Nov 10 19:20:14 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:20:14 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:20:14 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:20:14 user nova-compute[75026]:   </cpu>
Nov 10 19:20:14 user nova-compute[75026]:   <devices>
Nov 10 19:20:14 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:20:14 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:20:14 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk"/>
Nov 10 19:20:14 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:20:14 user nova-compute[75026]:     </disk>
Nov 10 19:20:14 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:20:14 user nova-compute[75026]:       <mac address="fa:16:3e:5b:28:b1"/>
Nov 10 19:20:14 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:20:14 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:20:14 user nova-compute[75026]:       <target dev="tap90fe5a1f-83"/>
Nov 10 19:20:14 user nova-compute[75026]:     </interface>
Nov 10 19:20:14 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:20:14 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/console.log" append="off"/>
Nov 10 19:20:14 user nova-compute[75026]:     </serial>
Nov 10 19:20:14 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:20:14 user nova-compute[75026]:     <video>
Nov 10 19:20:14 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:20:14 user nova-compute[75026]:     </video>
Nov 10 19:20:14 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:20:14 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:20:14 user nova-compute[75026]:     </rng>
Nov 10 19:20:14 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:20:14 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:20:14 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:20:14 user nova-compute[75026]:     </memballoon>
Nov 10 19:20:14 user nova-compute[75026]:   </devices>
Nov 10 19:20:14 user nova-compute[75026]: </domain>
Nov 10 19:20:14 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-132465',display_name='tempest-VolumesAdminNegativeTest-server-132465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-132465',id=13,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89956906ad1943408b1783771ee6aa32',ramdisk_id='',reservation_id='r-c1k407yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1994864820',owner_user_name='tempest-VolumesAdminNegativeTest-1994864820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:20:12Z,user_data=None,user_id='f2f78c518af14d6e84894f850811426b',uuid=e220bb5d-26bb-4939-a635-ba5d946e7657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converting VIF {"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:28:b1,bridge_name='br-int',has_traffic_filtering=True,id=90fe5a1f-83fe-41eb-8576-77be36d51234,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fe5a1f-83') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG os_vif [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:28:b1,bridge_name='br-int',has_traffic_filtering=True,id=90fe5a1f-83fe-41eb-8576-77be36d51234,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fe5a1f-83') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20247688-aef6-5716-9b1a-f5de7a4892c9', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90fe5a1f-83, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90fe5a1f-83, col_values=(('qos', UUID('28c36a95-958c-4ea9-9058-044db8d2985e')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90fe5a1f-83, col_values=(('external_ids', {'iface-id': '90fe5a1f-83fe-41eb-8576-77be36d51234', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:28:b1', 'vm-uuid': 'e220bb5d-26bb-4939-a635-ba5d946e7657'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: INFO os_vif [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:28:b1,bridge_name='br-int',has_traffic_filtering=True,id=90fe5a1f-83fe-41eb-8576-77be36d51234,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fe5a1f-83')
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] No VIF found with MAC fa:16:3e:5b:28:b1, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:20:14 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Instance destroyed successfully.
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lazy-loading 'resources' on Instance uuid 09a67456-da2f-4478-8c9a-6cac0e505134 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1123706193',display_name='tempest-VolumesAssistedSnapshotsTest-server-1123706193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1123706193',id=6,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa77mg5u7kS1a5zU11kmyAYcs9vqpmTtIcALdLmeHQ0rVdhLyHlIuDLTS5zc3aYkx5CR7YDmyzcvjdex+SSOjROxtIs++dnyozZ+EQpixaNEAZ+Odbf41yuqJfvHbZ2rQ==',key_name='tempest-keypair-588512440',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:16:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b882af2ac95d4e998aa57a51dd0c5d8e',ramdisk_id='',reservation_id='r-tklbfm2s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1956635969',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1956635969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c44130de62f5424ea1182f89978ce67a',uuid=09a67456-da2f-4478-8c9a-6cac0e505134,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Converting VIF {"id": "e362b1aa-9251-4e43-b3af-3c825324f644", "address": "fa:16:3e:46:08:cd", "network": {"id": "cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-679644921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b882af2ac95d4e998aa57a51dd0c5d8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape362b1aa-92", "ovs_interfaceid": "e362b1aa-9251-4e43-b3af-3c825324f644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=e362b1aa-9251-4e43-b3af-3c825324f644,network=Network(cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape362b1aa-92') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG os_vif [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=e362b1aa-9251-4e43-b3af-3c825324f644,network=Network(cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape362b1aa-92') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape362b1aa-92, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc979a1f-9a82-443e-b237-e21cd347935a) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:14 user nova-compute[75026]: INFO os_vif [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:08:cd,bridge_name='br-int',has_traffic_filtering=True,id=e362b1aa-9251-4e43-b3af-3c825324f644,network=Network(cddbd2b4-32fb-4f4b-8a74-6c135b6bc41d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape362b1aa-92')
Nov 10 19:20:14 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Deleting instance files /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134_del
Nov 10 19:20:14 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Deletion of /opt/stack/data/nova/instances/09a67456-da2f-4478-8c9a-6cac0e505134_del complete
Nov 10 19:20:14 user nova-compute[75026]: INFO nova.compute.manager [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 10 19:20:14 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-c41bc523-5a94-4a46-8c60-2bc701671b6e req-ac30f472-9e0e-4508-a8f8-50fc6b195300 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Updated VIF entry in instance network info cache for port 90fe5a1f-83fe-41eb-8576-77be36d51234. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-c41bc523-5a94-4a46-8c60-2bc701671b6e req-ac30f472-9e0e-4508-a8f8-50fc6b195300 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Updating instance_info_cache with network_info: [{"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c41bc523-5a94-4a46-8c60-2bc701671b6e req-ac30f472-9e0e-4508-a8f8-50fc6b195300 service nova] Releasing lock "refresh_cache-e220bb5d-26bb-4939-a635-ba5d946e7657" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:15 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Took 1.05 seconds to deallocate network for instance.
Nov 10 19:20:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-9e47e9f6-c1cf-4cc5-80fd-5fb06ba6a708 req-d958911f-c42a-4e3f-b842-289629e7f1f1 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received event network-vif-deleted-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-4785971c-3e71-4145-b8ff-080749a72f5c req-a47683a3-8403-4588-b826-a53a45d02261 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received event network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4785971c-3e71-4145-b8ff-080749a72f5c req-a47683a3-8403-4588-b826-a53a45d02261 service nova] Acquiring lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4785971c-3e71-4145-b8ff-080749a72f5c req-a47683a3-8403-4588-b826-a53a45d02261 service nova] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4785971c-3e71-4145-b8ff-080749a72f5c req-a47683a3-8403-4588-b826-a53a45d02261 service nova] Lock "09a67456-da2f-4478-8c9a-6cac0e505134-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-4785971c-3e71-4145-b8ff-080749a72f5c req-a47683a3-8403-4588-b826-a53a45d02261 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] No waiting events found dispatching network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:15 user nova-compute[75026]: WARNING nova.compute.manager [req-4785971c-3e71-4145-b8ff-080749a72f5c req-a47683a3-8403-4588-b826-a53a45d02261 service nova] [instance: 09a67456-da2f-4478-8c9a-6cac0e505134] Received unexpected event network-vif-plugged-e362b1aa-9251-4e43-b3af-3c825324f644 for instance with vm_state deleted and task_state None.
Nov 10 19:20:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:15 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Deleted allocations for instance 09a67456-da2f-4478-8c9a-6cac0e505134
Nov 10 19:20:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5f8a50c2-e16c-49cb-9eea-74bacfd5aa32 tempest-VolumesAssistedSnapshotsTest-1956635969 tempest-VolumesAssistedSnapshotsTest-1956635969-project-member] Lock "09a67456-da2f-4478-8c9a-6cac0e505134" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.657s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-933cdf6c-fab9-4ff4-983e-db1572f4625f req-f6cd8eb1-c125-4a2a-9c09-16b47e51c774 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-933cdf6c-fab9-4ff4-983e-db1572f4625f req-f6cd8eb1-c125-4a2a-9c09-16b47e51c774 service nova] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-933cdf6c-fab9-4ff4-983e-db1572f4625f req-f6cd8eb1-c125-4a2a-9c09-16b47e51c774 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-933cdf6c-fab9-4ff4-983e-db1572f4625f req-f6cd8eb1-c125-4a2a-9c09-16b47e51c774 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-933cdf6c-fab9-4ff4-983e-db1572f4625f req-f6cd8eb1-c125-4a2a-9c09-16b47e51c774 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] No waiting events found dispatching network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:17 user nova-compute[75026]: WARNING nova.compute.manager [req-933cdf6c-fab9-4ff4-983e-db1572f4625f req-f6cd8eb1-c125-4a2a-9c09-16b47e51c774 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received unexpected event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 for instance with vm_state building and task_state spawning.
Nov 10 19:20:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:20:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Instance spawned successfully.
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:20:18 user nova-compute[75026]: INFO nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 10 19:20:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:20:18 user nova-compute[75026]: INFO nova.compute.manager [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Took 7.35 seconds to build instance.
Nov 10 19:20:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-560b1199-2589-4271-a722-78d631af8ef0 tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.462s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-0bcb26d3-4c38-4912-a237-bd4d561478ca req-bd3196c4-6beb-46bc-8f47-4656eafc45be service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0bcb26d3-4c38-4912-a237-bd4d561478ca req-bd3196c4-6beb-46bc-8f47-4656eafc45be service nova] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0bcb26d3-4c38-4912-a237-bd4d561478ca req-bd3196c4-6beb-46bc-8f47-4656eafc45be service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0bcb26d3-4c38-4912-a237-bd4d561478ca req-bd3196c4-6beb-46bc-8f47-4656eafc45be service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-0bcb26d3-4c38-4912-a237-bd4d561478ca req-bd3196c4-6beb-46bc-8f47-4656eafc45be service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] No waiting events found dispatching network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:19 user nova-compute[75026]: WARNING nova.compute.manager [req-0bcb26d3-4c38-4912-a237-bd4d561478ca req-bd3196c4-6beb-46bc-8f47-4656eafc45be service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received unexpected event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 for instance with vm_state active and task_state None.
Nov 10 19:20:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-3d39c21e-dc7a-4c68-9eda-f41ff885687f req-7adf4058-ff44-47a7-b4da-a55abb9648cb service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received event network-changed-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-3d39c21e-dc7a-4c68-9eda-f41ff885687f req-7adf4058-ff44-47a7-b4da-a55abb9648cb service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Refreshing instance network info cache due to event network-changed-4d4b1476-7a64-4370-aa6c-71afdb5ca843. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:20:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3d39c21e-dc7a-4c68-9eda-f41ff885687f req-7adf4058-ff44-47a7-b4da-a55abb9648cb service nova] Acquiring lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:20:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3d39c21e-dc7a-4c68-9eda-f41ff885687f req-7adf4058-ff44-47a7-b4da-a55abb9648cb service nova] Acquired lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:20:22 user nova-compute[75026]: DEBUG nova.network.neutron [req-3d39c21e-dc7a-4c68-9eda-f41ff885687f req-7adf4058-ff44-47a7-b4da-a55abb9648cb service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Refreshing network info cache for port 4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:20:23 user nova-compute[75026]: DEBUG nova.network.neutron [req-3d39c21e-dc7a-4c68-9eda-f41ff885687f req-7adf4058-ff44-47a7-b4da-a55abb9648cb service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updated VIF entry in instance network info cache for port 4d4b1476-7a64-4370-aa6c-71afdb5ca843. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:20:23 user nova-compute[75026]: DEBUG nova.network.neutron [req-3d39c21e-dc7a-4c68-9eda-f41ff885687f req-7adf4058-ff44-47a7-b4da-a55abb9648cb service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updating instance_info_cache with network_info: [{"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3d39c21e-dc7a-4c68-9eda-f41ff885687f req-7adf4058-ff44-47a7-b4da-a55abb9648cb service nova] Releasing lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:20:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:24 user nova-compute[75026]: INFO nova.compute.manager [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Rebuilding instance
Nov 10 19:20:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-018ebd9d-56ee-4bbf-b393-26e4b83a53a8 req-9c91b091-c694-433c-bf2a-a5157af6e69d service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received event network-vif-unplugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-018ebd9d-56ee-4bbf-b393-26e4b83a53a8 req-9c91b091-c694-433c-bf2a-a5157af6e69d service nova] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-018ebd9d-56ee-4bbf-b393-26e4b83a53a8 req-9c91b091-c694-433c-bf2a-a5157af6e69d service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-018ebd9d-56ee-4bbf-b393-26e4b83a53a8 req-9c91b091-c694-433c-bf2a-a5157af6e69d service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-018ebd9d-56ee-4bbf-b393-26e4b83a53a8 req-9c91b091-c694-433c-bf2a-a5157af6e69d service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] No waiting events found dispatching network-vif-unplugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:24 user nova-compute[75026]: WARNING nova.compute.manager [req-018ebd9d-56ee-4bbf-b393-26e4b83a53a8 req-9c91b091-c694-433c-bf2a-a5157af6e69d service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received unexpected event network-vif-unplugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 for instance with vm_state active and task_state rebuilding.
Nov 10 19:20:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Instance destroyed successfully.
Nov 10 19:20:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Instance destroyed successfully.
Nov 10 19:20:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1631229507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-162507539',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRD8myHOfIhviu7LfFnBihpO63lRGsWq1HpX5chid9pgfh39F9om3fOpUOeK796Dxjla897sHiGYLDgEOk7pyFgQBoCBBrE5hhw1iV8IbOeo2vVmNrw0cMSi8cUNDQ1OA==',key_name='tempest-keypair-528756599',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:18:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c4d825c26084145af53ad27bb9ebcec',ramdisk_id='',reservation_id='r-g0r0xvj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2124583126',owner_user_name='tempest-ServerActionsV293TestJSON-2124583126-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e249c4693e7f4301b7ee850a0a2a3e45',uuid=0c42552f-3882-4f34-bf6a-fdef6a69e785,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Converting VIF {"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_vif [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d4b1476-7a, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=568da4f3-7bef-4d37-86bf-454b37a7f77a) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:25 user nova-compute[75026]: INFO os_vif [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a')
Nov 10 19:20:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUfquvom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:20:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2cd6a6-3be0-4d9f-ac08-b18a1e38a55e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:20:25 user nova-compute[75026]: No targets found.
Nov 10 19:20:25 user nova-compute[75026]: iSNS:
Nov 10 19:20:25 user nova-compute[75026]: No targets found.
Nov 10 19:20:25 user nova-compute[75026]: STATIC:
Nov 10 19:20:25 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88
Nov 10 19:20:25 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:20:25 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:20:25 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90
Nov 10 19:20:25 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:20:25 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:20:25 user nova-compute[75026]: FIRMWARE:
Nov 10 19:20:25 user nova-compute[75026]: No targets found.
Nov 10 19:20:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:20:25 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:20:25 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[810b9376-4dca-4057-bf10-717029174ca8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c285dc-31b5-4800-8a04-1c59b349c568]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:20:25 user nova-compute[75026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 (non-flash)
Nov 10 19:20:25 user nova-compute[75026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda3c29750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[509c40bb-47b0-48c7-8265-fe11cccad046]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e57551-f8e2-424d-b819-1e9c177a7a0a]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d880e0-bb27-48d6-b00f-71ead5db95c5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.069s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9d054e-a6cb-443f-8500-45cc39ae645d]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.134s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b207df-0242-4495-beba-8fa31c7df712]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e39897-d4cd-4bdb-b024-4f635bf56498]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88, portal: 172.16.0.220,3260]
Nov 10 19:20:25 user nova-compute[75026]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88, portal: 172.16.0.220,3260] successful.
Nov 10 19:20:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac612e26-96c3-486e-93e3-b041459d6d13]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.523s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] <== disconnect_volume: return (525ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:20:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Deleting instance files /opt/stack/data/nova/instances/0c42552f-3882-4f34-bf6a-fdef6a69e785_del
Nov 10 19:20:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Deletion of /opt/stack/data/nova/instances/0c42552f-3882-4f34-bf6a-fdef6a69e785_del complete
Nov 10 19:20:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:20:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:20:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:20:25 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 could not be found.
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe506b07-063f-4e78-b9ee-0ff3a3e5eca1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:20:25 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUfquvom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:20:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.072s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[033dcda3-e5c7-4cc2-bf5d-d867886650a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab] added
Nov 10 19:20:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.054s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6241dc-803e-4964-817a-4dc5d5f0ad4d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62b326c-0e82-4d6b-83b2-ad471d6f0499]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymdNOxet {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymdNOxet" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d997eb3-b981-42be-971d-8b26a43a43cb]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ymdNOxet'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a862b2e-1450-48f3-ad05-d9de882ea31d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe27c58-eedf-4e28-af60-7c4bb12edc09]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7522f-ed67-4833-9406-38ecb9fe8c2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]
Nov 10 19:20:26 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.
Nov 10 19:20:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c18b32e-6d5c-46ba-a45a-e2cf2172af58]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc356e9a-afbf-45a3-95b8-316d72f7264e]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:26 user nova-compute[75026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:20:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:26 user nova-compute[75026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:20:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c68c55-0038-4e99-bc16-0c6f13734940]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-9e5d41f2-314d-44f0-b13d-7afa14cc81ac req-c7676e80-c9c8-4498-ab4c-68b44756ac3b service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received event network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9e5d41f2-314d-44f0-b13d-7afa14cc81ac req-c7676e80-c9c8-4498-ab4c-68b44756ac3b service nova] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9e5d41f2-314d-44f0-b13d-7afa14cc81ac req-c7676e80-c9c8-4498-ab4c-68b44756ac3b service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9e5d41f2-314d-44f0-b13d-7afa14cc81ac req-c7676e80-c9c8-4498-ab4c-68b44756ac3b service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-9e5d41f2-314d-44f0-b13d-7afa14cc81ac req-c7676e80-c9c8-4498-ab4c-68b44756ac3b service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] No waiting events found dispatching network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:26 user nova-compute[75026]: WARNING nova.compute.manager [req-9e5d41f2-314d-44f0-b13d-7afa14cc81ac req-c7676e80-c9c8-4498-ab4c-68b44756ac3b service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received unexpected event network-vif-plugged-4d4b1476-7a64-4370-aa6c-71afdb5ca843 for instance with vm_state active and task_state rebuilding.
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23833346135626337', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833346135626337', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.380s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG nova.objects.instance [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lazy-loading 'flavor' on Instance uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c877e-9782-44c6-a942-63a254b8dac3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:20:27 user nova-compute[75026]: No targets found.
Nov 10 19:20:27 user nova-compute[75026]: iSNS:
Nov 10 19:20:27 user nova-compute[75026]: No targets found.
Nov 10 19:20:27 user nova-compute[75026]: STATIC:
Nov 10 19:20:27 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:20:27 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:20:27 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:20:27 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90
Nov 10 19:20:27 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:20:27 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:20:27 user nova-compute[75026]: FIRMWARE:
Nov 10 19:20:27 user nova-compute[75026]: No targets found.
Nov 10 19:20:27 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:20:27 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:20:27 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:20:27 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:20:27 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:20:27 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:20:27 user nova-compute[75026]:   <serial>8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab</serial>
Nov 10 19:20:27 user nova-compute[75026]: </disk>
Nov 10 19:20:27 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0749a-6e20-4b15-94ae-01d279e4faa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ac4da4-f21b-4cb9-a610-c6a0d5771bb8]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:27 user nova-compute[75026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:20:27 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:27 user nova-compute[75026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:20:27 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda01aca60>, {}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Disconnecting from: [] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] <== disconnect_volume: return (1467ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:20:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] No VIF found with MAC fa:16:3e:17:eb:e2, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:20:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-397d27f7-aa78-4924-afbc-0dc49921029c tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.352s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:28 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Preparing to wait for external event volume-reimaged-277e5d4b-3d2c-487d-9525-c2152138cb88 {{(pid=75026) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 10 19:20:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Stashing vm_state: active {{(pid=75026) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 19:20:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:30 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:20:30 user nova-compute[75026]: INFO nova.compute.claims [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Claim successful on node user
Nov 10 19:20:30 user nova-compute[75026]: INFO nova.compute.resource_tracker [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating resource usage from migration 2101dbc2-59a6-45e3-82a1-4d5d9e6619ef
Nov 10 19:20:31 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.439s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:31 user nova-compute[75026]: INFO nova.compute.manager [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Migrating
Nov 10 19:20:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:20:31 user nova-compute[75026]: INFO nova.compute.rpcapi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 10 19:20:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:20:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Starting migrate_disk_and_power_off {{(pid=75026) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-0cf95c45-4d21-47f3-aa18-ca2c95935304 req-9a3c1fb9-ddb2-4abd-a152-5a01d1be35b5 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cf95c45-4d21-47f3-aa18-ca2c95935304 req-9a3c1fb9-ddb2-4abd-a152-5a01d1be35b5 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cf95c45-4d21-47f3-aa18-ca2c95935304 req-9a3c1fb9-ddb2-4abd-a152-5a01d1be35b5 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cf95c45-4d21-47f3-aa18-ca2c95935304 req-9a3c1fb9-ddb2-4abd-a152-5a01d1be35b5 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-0cf95c45-4d21-47f3-aa18-ca2c95935304 req-9a3c1fb9-ddb2-4abd-a152-5a01d1be35b5 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:32 user nova-compute[75026]: WARNING nova.compute.manager [req-0cf95c45-4d21-47f3-aa18-ca2c95935304 req-9a3c1fb9-ddb2-4abd-a152-5a01d1be35b5 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state active and task_state resize_migrating.
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance destroyed successfully.
Nov 10 19:20:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:16:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:20:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-548694425-network", "vif_mac": "fa:16:3e:17:eb:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-548694425-network", "vif_mac": "fa:16:3e:17:eb:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_vif [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc7927d-74, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae66602b-81c1-40ce-bc40-da713fc7fba5) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:32 user nova-compute[75026]: INFO os_vif [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74')
Nov 10 19:20:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:20:32 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b88988b-9fc1-4812-a663-7dc0bffcdab4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:20:32 user nova-compute[75026]: No targets found.
Nov 10 19:20:32 user nova-compute[75026]: iSNS:
Nov 10 19:20:32 user nova-compute[75026]: No targets found.
Nov 10 19:20:32 user nova-compute[75026]: STATIC:
Nov 10 19:20:32 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:20:32 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:20:32 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:20:32 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90
Nov 10 19:20:32 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:20:32 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:20:32 user nova-compute[75026]: FIRMWARE:
Nov 10 19:20:32 user nova-compute[75026]: No targets found.
Nov 10 19:20:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:20:32 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:20:32 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[159f6f0a-36a1-4aba-b9d8-84436db21403]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84202630-ea01-4a7b-a3b8-4f1def05312c]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:32 user nova-compute[75026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:20:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:32 user nova-compute[75026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:20:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda02940d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce856168-974d-4635-939f-a2d57290a913]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad5decf-0692-47b9-89a5-f0800678583b]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:20:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61986b9b-cafa-4084-95d4-109e5c82911e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[835f03a9-a1ca-4da5-a619-d770b039a0e3]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bfe753-b7bb-41d9-b0a3-39f8e8b5154a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2143e1-15e8-426c-a440-7f0b8d3c9b5f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]
Nov 10 19:20:33 user nova-compute[75026]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.
Nov 10 19:20:33 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33dfeef-e20f-44f8-b49d-566a1c78e882]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== disconnect_volume: return (354ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249_resize/disk /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG nova.compute.manager [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBVMdRJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ca3830d-1edf-4638-a5cf-6cf6efe37362', 'attached_at': '', 'detached_at': '', 'volume_id': 'c98e1d59-365f-4ef5-bca7-159f38187ce8', 'serial': 'c98e1d59-365f-4ef5-bca7-159f38187ce8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5ca3830d-1edf-4638-a5cf-6cf6efe37362', 'attached_at': '', 'detached_at': '', 'volume_id': '1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'serial'} {{(pid=75026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBVMdRJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:20:33 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:20:33 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:20:33 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da87fb3-bd1a-4051-b0d2-c24e9a74646a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:20:33 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c314786-996c-489f-aae7-ccaee93edaa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8] added
Nov 10 19:20:33 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d466c39b-fea0-44a2-b237-0f7526ba40be]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c41cfd-1f6f-4388-af44-9e607ac519f6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBVMdRJx {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBVMdRJx" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[460bc7ff-6b3e-4b14-b54a-890c63b32acb]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rBVMdRJx'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d95c00-d25b-47a5-90c3-25523058e481]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ba20d1-9c81-46fc-8ecf-66cfafe85a69]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:33 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:33 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "cp -r /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249_resize/disk /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk" returned: 0 in 0.282s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249_resize/disk.info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk.info {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[390c8b64-8259-4c0b-9de5-9d4a541eaaa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8, portal: 172.16.0.220,3260]
Nov 10 19:20:34 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8, portal: 172.16.0.220,3260] successful.
Nov 10 19:20:34 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "cp -r /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249_resize/disk.info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk.info" returned: 0 in 0.046s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d5cfb7-bc1b-43a1-a40a-7abf980b39b3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b247a4-b75d-45b5-ab96-319c18a7d15d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:20:34 user nova-compute[75026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:34 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:20:34 user nova-compute[75026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:34 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b78c29e-6020-4bf0-9692-6b950db96eaf]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBVMdRJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-c4bde620-bdc2-420f-ac9d-9fed0c8f13ad req-c0cad4a3-5728-470b-922f-5ac99fa4a431 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c4bde620-bdc2-420f-ac9d-9fed0c8f13ad req-c0cad4a3-5728-470b-922f-5ac99fa4a431 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c4bde620-bdc2-420f-ac9d-9fed0c8f13ad req-c0cad4a3-5728-470b-922f-5ac99fa4a431 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c4bde620-bdc2-420f-ac9d-9fed0c8f13ad req-c0cad4a3-5728-470b-922f-5ac99fa4a431 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-c4bde620-bdc2-420f-ac9d-9fed0c8f13ad req-c0cad4a3-5728-470b-922f-5ac99fa4a431 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:34 user nova-compute[75026]: WARNING nova.compute.manager [req-c4bde620-bdc2-420f-ac9d-9fed0c8f13ad req-c0cad4a3-5728-470b-922f-5ac99fa4a431 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state active and task_state resize_migrating.
Nov 10 19:20:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23232643564326163', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232643564326163', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG nova.objects.instance [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lazy-loading 'flavor' on Instance uuid 5ca3830d-1edf-4638-a5cf-6cf6efe37362 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Port acc7927d-7433-4d3b-a371-9b1433e46ee1 binding to destination host user is already ACTIVE {{(pid=75026) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 3145728 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:35 user nova-compute[75026]: INFO nova.compute.manager [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Terminating instance
Nov 10 19:20:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.network.neutron [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-7862245d-ee0c-4ba4-8150-8fba7762bfe3 req-56a0cc6c-685f-4e38-9ed0-d7fb7ddee43a service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-unplugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7862245d-ee0c-4ba4-8150-8fba7762bfe3 req-56a0cc6c-685f-4e38-9ed0-d7fb7ddee43a service nova] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7862245d-ee0c-4ba4-8150-8fba7762bfe3 req-56a0cc6c-685f-4e38-9ed0-d7fb7ddee43a service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7862245d-ee0c-4ba4-8150-8fba7762bfe3 req-56a0cc6c-685f-4e38-9ed0-d7fb7ddee43a service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-7862245d-ee0c-4ba4-8150-8fba7762bfe3 req-56a0cc6c-685f-4e38-9ed0-d7fb7ddee43a service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] No waiting events found dispatching network-vif-unplugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-7862245d-ee0c-4ba4-8150-8fba7762bfe3 req-56a0cc6c-685f-4e38-9ed0-d7fb7ddee43a service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-unplugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 121634816 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Instance destroyed successfully.
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.objects.instance [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lazy-loading 'resources' on Instance uuid 4fc47635-99d4-47a8-a482-022d75931831 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709409501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709409501',id=7,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJee4FcWMqn7yDImAyqNMm+9ChC50iQjLFLtz76EKdUWcWepa4TiHxxsbaGcsSOzIq0v0NZDqndFRxsBw0/m9Zl8gKA4wnWPA9WY33aBBBxsuAP7yr8+QjE4uE1Ovehcpg==',key_name='tempest-keypair-554759005',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32dc3afe879d475a96ad9312fec0c3e9',ramdisk_id='',reservation_id='r-wfv3m9h3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-617120050',owner_user_name='tempest-TaggedAttachmentsTest-617120050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0eb014a1e2a42ce8f33dcf814421229',uuid=4fc47635-99d4-47a8-a482-022d75931831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converting VIF {"id": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "address": "fa:16:3e:49:9d:60", "network": {"id": "3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-518013202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32dc3afe879d475a96ad9312fec0c3e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2f1337-bb", "ovs_interfaceid": "8f2f1337-bb4e-4cc0-892d-418b29969d56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:9d:60,bridge_name='br-int',has_traffic_filtering=True,id=8f2f1337-bb4e-4cc0-892d-418b29969d56,network=Network(3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2f1337-bb') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG os_vif [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:9d:60,bridge_name='br-int',has_traffic_filtering=True,id=8f2f1337-bb4e-4cc0-892d-418b29969d56,network=Network(3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2f1337-bb') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f2f1337-bb, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 274726912 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99f2911a-232b-43d5-aa5b-dd80f3058e4a) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:36 user nova-compute[75026]: INFO os_vif [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:9d:60,bridge_name='br-int',has_traffic_filtering=True,id=8f2f1337-bb4e-4cc0-892d-418b29969d56,network=Network(3ee01a2a-80a4-4fbb-ada7-d44ce23c8e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2f1337-bb')
Nov 10 19:20:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Deleting instance files /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831_del
Nov 10 19:20:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Deletion of /opt/stack/data/nova/instances/4fc47635-99d4-47a8-a482-022d75931831_del complete
Nov 10 19:20:36 user nova-compute[75026]: INFO nova.compute.manager [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 10 19:20:36 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:20:36 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 4fc47635-99d4-47a8-a482-022d75931831] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG nova.network.neutron [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 433061888 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG os_brick.utils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1011d63b-f9ba-4b1d-8bb0-4381fe56d589]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ac5f46-70e3-456b-a1b7-96818762b4a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 552599552 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d723f-e336-41ed-a079-70206849aaba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74b3e41-3bcc-4115-8efc-0dee565ceed7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:20:37 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:20:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a47c51-1d94-499f-bf95-290af8d8ffd4]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:20:37 user nova-compute[75026]: DEBUG os_brick.utils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 705691648 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-aadf39a5-d25c-4a47-ad79-224c43556dd6 req-e82bdd98-d463-4f67-9ca0-184ffdac80b8 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aadf39a5-d25c-4a47-ad79-224c43556dd6 req-e82bdd98-d463-4f67-9ca0-184ffdac80b8 service nova] Acquiring lock "4fc47635-99d4-47a8-a482-022d75931831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aadf39a5-d25c-4a47-ad79-224c43556dd6 req-e82bdd98-d463-4f67-9ca0-184ffdac80b8 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aadf39a5-d25c-4a47-ad79-224c43556dd6 req-e82bdd98-d463-4f67-9ca0-184ffdac80b8 service nova] Lock "4fc47635-99d4-47a8-a482-022d75931831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-aadf39a5-d25c-4a47-ad79-224c43556dd6 req-e82bdd98-d463-4f67-9ca0-184ffdac80b8 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] No waiting events found dispatching network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:20:38 user nova-compute[75026]: WARNING nova.compute.manager [req-aadf39a5-d25c-4a47-ad79-224c43556dd6 req-e82bdd98-d463-4f67-9ca0-184ffdac80b8 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received unexpected event network-vif-plugged-8f2f1337-bb4e-4cc0-892d-418b29969d56 for instance with vm_state active and task_state deleting.
Nov 10 19:20:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:20:38 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Took 1.65 seconds to deallocate network for instance.
Nov 10 19:20:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 807403520 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.581s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:39 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Deleted allocations for instance 4fc47635-99d4-47a8-a482-022d75931831
Nov 10 19:20:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e8b0eb3c-0b20-4689-be85-655c2118be11 tempest-TaggedAttachmentsTest-617120050 tempest-TaggedAttachmentsTest-617120050-project-member] Lock "4fc47635-99d4-47a8-a482-022d75931831" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.686s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:20:39 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:20:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8506d3-2e69-47c9-a619-a7e1ded517b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:20:39 user nova-compute[75026]: No targets found.
Nov 10 19:20:39 user nova-compute[75026]: iSNS:
Nov 10 19:20:39 user nova-compute[75026]: No targets found.
Nov 10 19:20:39 user nova-compute[75026]: STATIC:
Nov 10 19:20:39 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8
Nov 10 19:20:39 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:20:39 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:20:39 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90
Nov 10 19:20:39 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:20:39 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:20:39 user nova-compute[75026]: FIRMWARE:
Nov 10 19:20:39 user nova-compute[75026]: No targets found.
Nov 10 19:20:39 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:20:39 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:20:39 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed62a93-2ff7-41ab-97ad-87a8aac1d44d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60ac7cb-a580-4b6b-971b-5559731a1c61]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:20:39 user nova-compute[75026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:39 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:20:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:20:39 user nova-compute[75026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:20:39 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0399fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8682ce36-67c9-4e91-b15d-560c420a3338]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc6142-d311-457d-8888-aa761a6b67cd]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad5a406-5538-4842-b017-6324abcfd253]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e18cda7-46e5-41b8-849a-06f617190576]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3185d790-55c8-4c23-9f9e-a5fa1dbd2b9f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4919a53b-183b-484e-a29a-2f4da03b3205]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260]
Nov 10 19:20:40 user nova-compute[75026]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260] successful.
Nov 10 19:20:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfcdd61-7ae6-4a78-9e01-864fdd14bb90]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] <== disconnect_volume: return (368ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-42b063df-3fa6-4d21-ad83-1277a8c6bf06 req-15bd21ea-97fc-4c33-a815-72f62b66d922 service nova] [instance: 4fc47635-99d4-47a8-a482-022d75931831] Received event network-vif-deleted-8f2f1337-bb4e-4cc0-892d-418b29969d56 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBVMdRJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '5ca3830d-1edf-4638-a5cf-6cf6efe37362', 'attached_at': '', 'detached_at': '', 'volume_id': 'c98e1d59-365f-4ef5-bca7-159f38187ce8', 'serial'} {{(pid=75026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 19:20:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] swap_volume: removing Cinder connection for volume 1df6ace3-5824-4d80-8bbc-e6802d7d9b90 {{(pid=75026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 19:20:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] swap_volume: Updating volume 1df6ace3-5824-4d80-8bbc-e6802d7d9b90 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "rBVMdRJx", "auth_password": "RiYaPZ2MDxpo4w", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "c98e1d59-365f-4ef5-bca7-159f38187ce8"}, "status": "reserved", "instance": "5ca3830d-1edf-4638-a5cf-6cf6efe37362", "attached_at": "", "detached_at": "", "volume_id": "c98e1d59-365f-4ef5-bca7-159f38187ce8", "serial": "c98e1d59-365f-4ef5-bca7-159f38187ce8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c98e1d59-365f-4ef5-bca7-159f38187ce8', 'no_device': None, 'attachment_id': '6c2dccde-2ea3-45e3-a5b2-2ef92eee6d3e'} {{(pid=75026) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 19:20:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-afe4f84a-a416-4c49-b7d8-7a72693e4be8 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 44.050s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:20:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG os_brick.utils [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1d707c-468d-465e-b6e0-eb0a8987b2f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43b0ed6-bdd7-47c8-a109-04220a4fd268]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a92d5f8-d6fb-4ef3-95ef-1f73bfbcd5b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c46d13-9116-4f07-b101-ad9234ac468e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:20:42 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:20:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8a29b0-a7df-4824-804f-16f1c71f9c45]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:20:42 user nova-compute[75026]: DEBUG os_brick.utils [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:20:42 user nova-compute[75026]: INFO nova.compute.manager [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Swapping volume c98e1d59-365f-4ef5-bca7-159f38187ce8 for 1df6ace3-5824-4d80-8bbc-e6802d7d9b90
Nov 10 19:20:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:20:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:20:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:20:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:20:59 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:20:59 user nova-compute[75026]: INFO nova.compute.claims [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Claim successful on node user
Nov 10 19:21:00 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:21:00 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:21:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:21:00 user nova-compute[75026]: INFO nova.virt.block_device [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Booting with volume 5909e5b4-3695-4425-b3dd-9c6cb52328f8 at /dev/vda
Nov 10 19:21:00 user nova-compute[75026]: DEBUG nova.policy [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ece2c4c22cf436083e053d9f2cf26db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9addd4a21ed84ad9a226da278b948f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG os_brick.utils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd27a2fe-8e8e-479b-bfac-97734ce2d97b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d55f35-fb35-4cce-93ae-796fe6b87c9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500e937-a859-402f-a8e4-81255708504f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b5f11-e9b3-4309-aee5-6385217f5bf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:21:00 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:21:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1934591b-8138-407d-9b2b-d96d6483acd0]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG os_brick.utils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:21:00 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating existing volume attachment record: 9617b26d-a372-4c0f-9a3a-13ccaf1624d9 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:21:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully created port: 0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:21:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully created port: 8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:21:02 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully created port: 9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:21:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully created port: 8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:21:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully created port: 37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:21:03 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:21:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:21:04 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully updated port: 0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:21:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-5b6358ce-4adf-4f55-b94d-e2b61fe79874 req-912273b6-8015-48ae-98e5-d39b79455a0b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-changed-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-5b6358ce-4adf-4f55-b94d-e2b61fe79874 req-912273b6-8015-48ae-98e5-d39b79455a0b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing instance network info cache due to event network-changed-0ca08991-e4a7-472e-9b3b-fa8859848b3d. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:21:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5b6358ce-4adf-4f55-b94d-e2b61fe79874 req-912273b6-8015-48ae-98e5-d39b79455a0b service nova] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5b6358ce-4adf-4f55-b94d-e2b61fe79874 req-912273b6-8015-48ae-98e5-d39b79455a0b service nova] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:04 user nova-compute[75026]: DEBUG nova.network.neutron [req-5b6358ce-4adf-4f55-b94d-e2b61fe79874 req-912273b6-8015-48ae-98e5-d39b79455a0b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing network info cache for port 0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:21:04 user nova-compute[75026]: DEBUG nova.network.neutron [req-5b6358ce-4adf-4f55-b94d-e2b61fe79874 req-912273b6-8015-48ae-98e5-d39b79455a0b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG nova.network.neutron [req-5b6358ce-4adf-4f55-b94d-e2b61fe79874 req-912273b6-8015-48ae-98e5-d39b79455a0b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5b6358ce-4adf-4f55-b94d-e2b61fe79874 req-912273b6-8015-48ae-98e5-d39b79455a0b service nova] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully updated port: 532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:21:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully updated port: 21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-changed-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing instance network info cache due to event network-changed-532b429b-bd11-489f-a885-1c50ab94ca0e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:06 user nova-compute[75026]: DEBUG nova.network.neutron [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing network info cache for port 532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG nova.network.neutron [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG nova.network.neutron [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully updated port: 8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-changed-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing instance network info cache due to event network-changed-21ba1689-92a0-4756-b441-d5c39fd32bf9. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG nova.network.neutron [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing network info cache for port 21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG nova.network.neutron [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG nova.network.neutron [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-842fabc2-c70d-4f22-932e-e3a7f8e0bbf3 req-9d475c67-72f1-475f-a3d0-4638bdc39953 service nova] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully updated port: 9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Starting finish_migration {{(pid=75026) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance directory exists: not creating {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 19:21:08 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Creating image(s)
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.226s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk. size=21474836480 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk 21474836480 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk 21474836480" returned: 0 in 0.063s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Ensure instance console log exists: /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Start _get_guest_xml network_info=[{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-548694425-network", "vif_mac": "fa:16:3e:17:eb:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '08cde758-b4b8-41c5-96b8-81225a111787', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '01641144-84e2-49f1-9d09-6a15a9f42249', 'attached_at': '2023-11-10T19:21:07.000000', 'detached_at': '', 'volume_id': '8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'serial': '8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:21:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:21:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully updated port: 8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:21:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.manager [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-changed-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.manager [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing instance network info cache due to event network-changed-8f6497a9-e4cf-46d2-a255-c55eabcc9531. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing network info cache for port 8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:21:09 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:21:09 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:21:09 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:21:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8156MB free_disk=25.67597198486328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e31d04-1156-4094-97cd-0267517dac5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:21:09 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[20662964-239f-4b2c-aca3-ee323b36c5be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab] added
Nov 10 19:21:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d86bbca-e448-4d21-8e3f-a19ea3aa1164]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b175155-3762-4710-9b2c-59b0482b7355]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymdNOxet {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymdNOxet" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee44fc5-14b7-4d09-92e9-ef03e6a44bb6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ymdNOxet'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Applying migration context for instance 01641144-84e2-49f1-9d09-6a15a9f42249 as it has an incoming, in-progress migration 2101dbc2-59a6-45e3-82a1-4d5d9e6619ef. Migration status is post-migrating {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 19:21:09 user nova-compute[75026]: INFO nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating resource usage from migration 2101dbc2-59a6-45e3-82a1-4d5d9e6619ef
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[57580739-adad-4c0c-ae86-563f673234d2]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[957d163d-dcfe-4014-9eda-b2182ae36cb9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance d57c5ada-750c-41af-a14c-6546374cf5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f86437d3-8401-4c25-8122-1dcb98c1cd19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e220bb5d-26bb-4939-a635-ba5d946e7657 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Migration 2101dbc2-59a6-45e3-82a1-4d5d9e6619ef is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cb5a07-c1d9-4310-99ef-8bafa9e41f56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]
Nov 10 19:21:09 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.
Nov 10 19:21:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1a0af-3c96-42f9-ba30-91b454dd0738]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bee6d5d-b601-4660-9f9d-5ab3fc1bb6fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:09 user nova-compute[75026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:09 user nova-compute[75026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb344f6f-f147-4703-b63e-4aeaa13abc3b]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.manager [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-changed-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.compute.manager [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing instance network info cache due to event network-changed-9f98a01d-0d0f-4457-a1ec-06649ad24312. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:09 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing network info cache for port 9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-changed-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing instance network info cache due to event network-changed-8155e82e-493d-4bcc-918f-571aac53ecb1. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing network info cache for port 8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Successfully updated port: 37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.neutron [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8d7acef6-db2b-49ab-827f-e9dec00c5c11 req-170f4bf5-435e-43e0-a5e5-052e12c503b7 service nova] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23833346135626337', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833346135626337', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:16:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-548694425-network", "vif_mac": "fa:16:3e:17:eb:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-548694425-network", "vif_mac": "fa:16:3e:17:eb:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:21:10 user nova-compute[75026]:   <uuid>01641144-84e2-49f1-9d09-6a15a9f42249</uuid>
Nov 10 19:21:10 user nova-compute[75026]:   <name>instance-00000002</name>
Nov 10 19:21:10 user nova-compute[75026]:   <memory>2097152</memory>
Nov 10 19:21:10 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:21:10 user nova-compute[75026]:   <metadata>
Nov 10 19:21:10 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:21:10 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:21:10 user nova-compute[75026]:       <nova:name>tempest-ServerActionsTestOtherB-server-451439939</nova:name>
Nov 10 19:21:10 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:21:08</nova:creationTime>
Nov 10 19:21:10 user nova-compute[75026]:       <nova:flavor name="m1.small">
Nov 10 19:21:10 user nova-compute[75026]:         <nova:memory>2048</nova:memory>
Nov 10 19:21:10 user nova-compute[75026]:         <nova:disk>20</nova:disk>
Nov 10 19:21:10 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:21:10 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:21:10 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:21:10 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:21:10 user nova-compute[75026]:       <nova:owner>
Nov 10 19:21:10 user nova-compute[75026]:         <nova:user uuid="c3955d2948c446c8b555fb7fea429581">tempest-ServerActionsTestOtherB-1354094982-project-member</nova:user>
Nov 10 19:21:10 user nova-compute[75026]:         <nova:project uuid="49d22011dbaa43728771bc3d1eefaa30">tempest-ServerActionsTestOtherB-1354094982</nova:project>
Nov 10 19:21:10 user nova-compute[75026]:       </nova:owner>
Nov 10 19:21:10 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:21:10 user nova-compute[75026]:       <nova:ports>
Nov 10 19:21:10 user nova-compute[75026]:         <nova:port uuid="acc7927d-7433-4d3b-a371-9b1433e46ee1">
Nov 10 19:21:10 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:21:10 user nova-compute[75026]:         </nova:port>
Nov 10 19:21:10 user nova-compute[75026]:       </nova:ports>
Nov 10 19:21:10 user nova-compute[75026]:     </nova:instance>
Nov 10 19:21:10 user nova-compute[75026]:   </metadata>
Nov 10 19:21:10 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:21:10 user nova-compute[75026]:     <system>
Nov 10 19:21:10 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:21:10 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:21:10 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:21:10 user nova-compute[75026]:       <entry name="serial">01641144-84e2-49f1-9d09-6a15a9f42249</entry>
Nov 10 19:21:10 user nova-compute[75026]:       <entry name="uuid">01641144-84e2-49f1-9d09-6a15a9f42249</entry>
Nov 10 19:21:10 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:21:10 user nova-compute[75026]:     </system>
Nov 10 19:21:10 user nova-compute[75026]:   </sysinfo>
Nov 10 19:21:10 user nova-compute[75026]:   <os>
Nov 10 19:21:10 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:21:10 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:21:10 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:21:10 user nova-compute[75026]:   </os>
Nov 10 19:21:10 user nova-compute[75026]:   <features>
Nov 10 19:21:10 user nova-compute[75026]:     <acpi/>
Nov 10 19:21:10 user nova-compute[75026]:     <apic/>
Nov 10 19:21:10 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:21:10 user nova-compute[75026]:   </features>
Nov 10 19:21:10 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:21:10 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:21:10 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:21:10 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:21:10 user nova-compute[75026]:   </clock>
Nov 10 19:21:10 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:21:10 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:21:10 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:21:10 user nova-compute[75026]:   </cpu>
Nov 10 19:21:10 user nova-compute[75026]:   <devices>
Nov 10 19:21:10 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:21:10 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:21:10 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk"/>
Nov 10 19:21:10 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:21:10 user nova-compute[75026]:     </disk>
Nov 10 19:21:10 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:21:10 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:21:10 user nova-compute[75026]:       <source dev="/dev/sdb"/>
Nov 10 19:21:10 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:21:10 user nova-compute[75026]:       <serial>8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab</serial>
Nov 10 19:21:10 user nova-compute[75026]:     </disk>
Nov 10 19:21:10 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:21:10 user nova-compute[75026]:       <mac address="fa:16:3e:17:eb:e2"/>
Nov 10 19:21:10 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:21:10 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:21:10 user nova-compute[75026]:       <target dev="tapacc7927d-74"/>
Nov 10 19:21:10 user nova-compute[75026]:     </interface>
Nov 10 19:21:10 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:21:10 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/console.log" append="off"/>
Nov 10 19:21:10 user nova-compute[75026]:     </serial>
Nov 10 19:21:10 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:21:10 user nova-compute[75026]:     <video>
Nov 10 19:21:10 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:21:10 user nova-compute[75026]:     </video>
Nov 10 19:21:10 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:21:10 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:21:10 user nova-compute[75026]:     </rng>
Nov 10 19:21:10 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:21:10 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:21:10 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:21:10 user nova-compute[75026]:     </memballoon>
Nov 10 19:21:10 user nova-compute[75026]:   </devices>
Nov 10 19:21:10 user nova-compute[75026]: </domain>
Nov 10 19:21:10 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:16:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-548694425-network", "vif_mac": "fa:16:3e:17:eb:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-548694425-network", "vif_mac": "fa:16:3e:17:eb:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG os_vif [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b260c134-c22f-503e-9239-5058f034d778', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc7927d-74, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacc7927d-74, col_values=(('qos', UUID('52de2362-8bee-4480-90a9-17251d46baa5')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacc7927d-74, col_values=(('external_ids', {'iface-id': 'acc7927d-7433-4d3b-a371-9b1433e46ee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:eb:e2', 'vm-uuid': '01641144-84e2-49f1-9d09-6a15a9f42249'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:10 user nova-compute[75026]: INFO os_vif [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74')
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:21:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] No VIF found with MAC fa:16:3e:17:eb:e2, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-5e58e579-cb0a-4a43-8ce0-18ad1ba195cf req-e0c7e4df-29d1-4d09-a85d-be8be5202655 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-changed-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-5e58e579-cb0a-4a43-8ce0-18ad1ba195cf req-e0c7e4df-29d1-4d09-a85d-be8be5202655 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing instance network info cache due to event network-changed-37f75097-1500-400d-9ef4-68318d093eec. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5e58e579-cb0a-4a43-8ce0-18ad1ba195cf req-e0c7e4df-29d1-4d09-a85d-be8be5202655 service nova] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ca3830d-1edf-4638-a5cf-6cf6efe37362', 'attached_at': '', 'detached_at': '', 'volume_id': '1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'serial': '1df6ace3-5824-4d80-8bbc-e6802d7d9b90'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBVMdRJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'c98e1d59-365f-4ef5-bca7-159f38187ce8'}, 'status': 'reserved', 'instance': '5ca3830d-1edf-4638-a5cf-6cf6efe37362', 'attached_at': '', 'detached_at': '', 'volume_id': 'c98e1d59-365f-4ef5-bca7-159f38187ce8', 'serial'} {{(pid=75026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:21:11 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:21:11 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:21:11 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d56df63-46bf-4f08-a3cb-406aa22088d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:21:11 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55153916-6277-4cb8-8339-48297baf389e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90] added
Nov 10 19:21:11 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c08b87-8554-4394-9b10-4dd502f9cb42]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f3d4c-20d1-4492-92fa-4277c246623a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ABdoyLvh {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ABdoyLvh" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[642f3ae3-9c1e-4550-9ead-f9d1442ae4bc]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ABdoyLvh'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0250db25-6436-4f29-b024-a783179e09f6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a7a00d-12bd-45d7-b8f1-0a4446d6fc36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:12 user nova-compute[75026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:12 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:12 user nova-compute[75026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:12 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e75ff-80b5-4e28-a6b4-415c305999f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260]
Nov 10 19:21:12 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260] successful.
Nov 10 19:21:12 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f6a0dc-30b0-4d96-b932-842b57a6d234]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7874763-43ae-4f9b-9934-5247278a787a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:12 user nova-compute[75026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:12 user nova-compute[75026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:21:12 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:12 user nova-compute[75026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:12 user nova-compute[75026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:21:12 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2436b7-2c58-4c08-8852-c404bc7d885f]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-5e3b3f24-8fe9-470b-ba64-206e3f1a2460 req-aa375eb8-b05c-4d18-808e-ed2916565925 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5e3b3f24-8fe9-470b-ba64-206e3f1a2460 req-aa375eb8-b05c-4d18-808e-ed2916565925 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5e3b3f24-8fe9-470b-ba64-206e3f1a2460 req-aa375eb8-b05c-4d18-808e-ed2916565925 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5e3b3f24-8fe9-470b-ba64-206e3f1a2460 req-aa375eb8-b05c-4d18-808e-ed2916565925 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-5e3b3f24-8fe9-470b-ba64-206e3f1a2460 req-aa375eb8-b05c-4d18-808e-ed2916565925 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:21:12 user nova-compute[75026]: WARNING nova.compute.manager [req-5e3b3f24-8fe9-470b-ba64-206e3f1a2460 req-aa375eb8-b05c-4d18-808e-ed2916565925 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state active and task_state resize_finish.
Nov 10 19:21:13 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23166646637353565', 'path': '/dev/sdd'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166646637353565', 'path': '/dev/sdd'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lazy-loading 'flavor' on Instance uuid 5ca3830d-1edf-4638-a5cf-6cf6efe37362 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [{"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance network_info: |[{"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5e58e579-cb0a-4a43-8ce0-18ad1ba195cf req-e0c7e4df-29d1-4d09-a85d-be8be5202655 service nova] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG nova.network.neutron [req-5e58e579-cb0a-4a43-8ce0-18ad1ba195cf req-e0c7e4df-29d1-4d09-a85d-be8be5202655 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing network info cache for port 37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:21:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-5e58e579-cb0a-4a43-8ce0-18ad1ba195cf req-e0c7e4df-29d1-4d09-a85d-be8be5202655 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updated VIF entry in instance network info cache for port 37f75097-1500-400d-9ef4-68318d093eec. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:21:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-5e58e579-cb0a-4a43-8ce0-18ad1ba195cf req-e0c7e4df-29d1-4d09-a85d-be8be5202655 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [{"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5e58e579-cb0a-4a43-8ce0-18ad1ba195cf req-e0c7e4df-29d1-4d09-a85d-be8be5202655 service nova] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 131072000 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 277872640 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-25c16864-3111-4212-b397-a1e255e9999b req-96c26291-be60-47b7-bf07-d9ec3a27ba62 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-25c16864-3111-4212-b397-a1e255e9999b req-96c26291-be60-47b7-bf07-d9ec3a27ba62 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-25c16864-3111-4212-b397-a1e255e9999b req-96c26291-be60-47b7-bf07-d9ec3a27ba62 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-25c16864-3111-4212-b397-a1e255e9999b req-96c26291-be60-47b7-bf07-d9ec3a27ba62 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-25c16864-3111-4212-b397-a1e255e9999b req-96c26291-be60-47b7-bf07-d9ec3a27ba62 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:21:15 user nova-compute[75026]: WARNING nova.compute.manager [req-25c16864-3111-4212-b397-a1e255e9999b req-96c26291-be60-47b7-bf07-d9ec3a27ba62 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state active and task_state resize_finish.
Nov 10 19:21:15 user nova-compute[75026]: DEBUG nova.compute.manager [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:21:15 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance running successfully.
Nov 10 19:21:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Failed to set time: agent not configured {{(pid=75026) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-72a62e5d-27a6-46a5-a9d9-b4ca5a68bfff tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] finish_migration finished successfully. {{(pid=75026) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 421527552 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 577765376 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 734003200 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 891289600 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 1032847360 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBVMdRJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'c98e1d59-365f-4ef5-bca7-159f38187ce8'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:21:17 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:21:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4feb11c-d7ce-4bad-b10a-5ce4b94fd7f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:21:17 user nova-compute[75026]: No targets found.
Nov 10 19:21:17 user nova-compute[75026]: iSNS:
Nov 10 19:21:17 user nova-compute[75026]: No targets found.
Nov 10 19:21:17 user nova-compute[75026]: STATIC:
Nov 10 19:21:17 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:21:17 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:21:17 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:21:17 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8
Nov 10 19:21:17 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:21:17 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:21:17 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90
Nov 10 19:21:17 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:21:17 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:21:17 user nova-compute[75026]: FIRMWARE:
Nov 10 19:21:17 user nova-compute[75026]: No targets found.
Nov 10 19:21:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:21:17 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:21:17 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:21:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1632ba98-0b8c-404b-965e-4a36cedccc6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f0ffdc-7ea8-4252-9618-ed5e8fd90a04]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:18 user nova-compute[75026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:18 user nova-compute[75026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:21:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 (non-flash)
Nov 10 19:21:18 user nova-compute[75026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:18 user nova-compute[75026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:21:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed982103a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe1739a-3184-4080-b627-749733df9db4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c030c1-47c2-4d39-8d64-f8d82acf828f]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d4d1e9-9850-450b-993c-cbbb5b53dfd0]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cdfdf4-cf5f-4a69-b198-8aad351fa9ce]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e143940b-7f81-4c5a-89dd-0023da428342]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf88ded-e726-49af-a0e4-357b8089e0dd]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8, portal: 172.16.0.220,3260]
Nov 10 19:21:18 user nova-compute[75026]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8, portal: 172.16.0.220,3260] successful.
Nov 10 19:21:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98e1d59-365f-4ef5-bca7-159f38187ce8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7288cbe4-b0e9-44f9-a539-b73e637972e3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] <== disconnect_volume: return (372ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5ca3830d-1edf-4638-a5cf-6cf6efe37362', 'attached_at': '', 'detached_at': '', 'volume_id': '1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'serial'} {{(pid=75026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 19:21:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] swap_volume: removing Cinder connection for volume c98e1d59-365f-4ef5-bca7-159f38187ce8 {{(pid=75026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 19:21:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] swap_volume: Updating volume c98e1d59-365f-4ef5-bca7-159f38187ce8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ABdoyLvh", "auth_password": "ObLFIoDS8yHVPN", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "1df6ace3-5824-4d80-8bbc-e6802d7d9b90"}, "status": "reserved", "instance": "5ca3830d-1edf-4638-a5cf-6cf6efe37362", "attached_at": "", "detached_at": "", "volume_id": "1df6ace3-5824-4d80-8bbc-e6802d7d9b90", "serial": "1df6ace3-5824-4d80-8bbc-e6802d7d9b90"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'no_device': None, 'attachment_id': '85df1912-f149-4c2a-be62-72c7c82b4a92'} {{(pid=75026) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 19:21:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ebbb1381-8ad9-46b3-8371-7bb74ee84dd5 tempest-TestVolumeSwap-228538246 tempest-TestVolumeSwap-228538246-project-admin] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 37.082s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:21 user nova-compute[75026]: INFO nova.compute.manager [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Detaching volume 1df6ace3-5824-4d80-8bbc-e6802d7d9b90
Nov 10 19:21:21 user nova-compute[75026]: INFO nova.virt.block_device [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Attempting to driver detach volume 1df6ace3-5824-4d80-8bbc-e6802d7d9b90 from mountpoint /dev/vdb
Nov 10 19:21:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Attempting to detach device vdb from instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:21:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:21:21 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:21:21 user nova-compute[75026]:   <source dev="/dev/sdd"/>
Nov 10 19:21:21 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:21:21 user nova-compute[75026]:   <serial>1df6ace3-5824-4d80-8bbc-e6802d7d9b90</serial>
Nov 10 19:21:21 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:21:21 user nova-compute[75026]: </disk>
Nov 10 19:21:21 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:21:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Successfully detached device vdb from instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 from the persistent domain config.
Nov 10 19:21:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:21:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:21:21 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:21:21 user nova-compute[75026]:   <source dev="/dev/sdd"/>
Nov 10 19:21:21 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:21:21 user nova-compute[75026]:   <serial>1df6ace3-5824-4d80-8bbc-e6802d7d9b90</serial>
Nov 10 19:21:21 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:21:21 user nova-compute[75026]: </disk>
Nov 10 19:21:21 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:21:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:21:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f6f341f-43aa-4799-b1c7-1327fb60ead7 req-6fe261d4-0d07-401c-9946-96af591a46a7 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received event network-changed-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:21:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f6f341f-43aa-4799-b1c7-1327fb60ead7 req-6fe261d4-0d07-401c-9946-96af591a46a7 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Refreshing instance network info cache due to event network-changed-6b6224ed-0ed5-4643-9ae0-ae460f8347b6. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:21:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f6f341f-43aa-4799-b1c7-1327fb60ead7 req-6fe261d4-0d07-401c-9946-96af591a46a7 service nova] Acquiring lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:21:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f6f341f-43aa-4799-b1c7-1327fb60ead7 req-6fe261d4-0d07-401c-9946-96af591a46a7 service nova] Acquired lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:21:24 user nova-compute[75026]: DEBUG nova.network.neutron [req-1f6f341f-43aa-4799-b1c7-1327fb60ead7 req-6fe261d4-0d07-401c-9946-96af591a46a7 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Refreshing network info cache for port 6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:21:25 user nova-compute[75026]: DEBUG nova.network.neutron [req-1f6f341f-43aa-4799-b1c7-1327fb60ead7 req-6fe261d4-0d07-401c-9946-96af591a46a7 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Updated VIF entry in instance network info cache for port 6b6224ed-0ed5-4643-9ae0-ae460f8347b6. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:21:25 user nova-compute[75026]: DEBUG nova.network.neutron [req-1f6f341f-43aa-4799-b1c7-1327fb60ead7 req-6fe261d4-0d07-401c-9946-96af591a46a7 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Updating instance_info_cache with network_info: [{"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:21:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f6f341f-43aa-4799-b1c7-1327fb60ead7 req-6fe261d4-0d07-401c-9946-96af591a46a7 service nova] Releasing lock "refresh_cache-f86437d3-8401-4c25-8122-1dcb98c1cd19" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:21:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:28 user nova-compute[75026]: WARNING nova.compute.manager [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Timeout waiting for ['volume-reimaged-277e5d4b-3d2c-487d-9525-c2152138cb88'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-277e5d4b-3d2c-487d-9525-c2152138cb88: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Nov 10 19:21:28 user nova-compute[75026]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7fed980f5060 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Nov 10 19:21:28 user nova-compute[75026]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Nov 10 19:21:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:29 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:21:29 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:21:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:29 user nova-compute[75026]: INFO nova.compute.manager [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Successfully reverted task state from rebuilding on failure for instance.
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server [None req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Exception during message handling: ValueError: Circular reference detected
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     next(self.gen)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Nov 10 19:21:29 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:21:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lazy-loading 'flavor' on Instance uuid f86437d3-8401-4c25-8122-1dcb98c1cd19 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:21:33 user nova-compute[75026]: INFO nova.compute.manager [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Attaching volume 5cbb2669-a8f5-44f3-a67e-512255271d02 to /dev/vdb
Nov 10 19:21:33 user nova-compute[75026]: DEBUG os_brick.utils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2e7986-9b07-4bfa-a7da-79bd651f9dfa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc79cb-1b43-45f8-834c-6dcd2e2a6e34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec5705-fc01-4a45-943e-bfb590399ef1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e759868-2cac-4f31-9d37-32a6cd221094]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:21:34 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:21:34 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b614949-06cb-49e5-9945-faf0cfc3763d]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG os_brick.utils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:21:34 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Updating existing volume attachment record: 6e713e99-477c-4c15-8e6d-4dd8fd84dd3c {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:21:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:41 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 is timed out.
Nov 10 19:21:41 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Successfully detached device vdb from instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 from the live domain config.
Nov 10 19:21:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ABdoyLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '1df6ace3-5824-4d80-8bbc-e6802d7d9b90'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:21:41 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e39268-edae-4e5c-9911-b634f573ec0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:21:41 user nova-compute[75026]: No targets found.
Nov 10 19:21:41 user nova-compute[75026]: iSNS:
Nov 10 19:21:41 user nova-compute[75026]: No targets found.
Nov 10 19:21:41 user nova-compute[75026]: STATIC:
Nov 10 19:21:41 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:21:41 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:21:41 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:21:41 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90
Nov 10 19:21:41 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:21:41 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:21:41 user nova-compute[75026]: FIRMWARE:
Nov 10 19:21:41 user nova-compute[75026]: No targets found.
Nov 10 19:21:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:21:41 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:21:41 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75124f5b-c8ad-4d2b-9b38-2d635f497b99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8167263f-afef-4b37-b74e-7a23dfafd0e5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:41 user nova-compute[75026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:21:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:21:41 user nova-compute[75026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 (non-flash)
Nov 10 19:21:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda039a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90'): ({'sdd'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Removing single pathed devices sdd {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64378dc-4d63-4c53-9339-47054bb82775]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f7357f-75f9-4a3d-8463-b92bc919d94c]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Flushing IO for device /dev/sdd {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3266f5-fb2c-439b-8c48-99ecdb40eec6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b7af25-146f-4915-b0a7-e5ee72af6c8a]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa1fc5d-9a43-46a1-b070-e3f5ad24d208]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a39034-76dc-4fbc-ba94-739df94c997c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260]
Nov 10 19:21:41 user nova-compute[75026]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90, portal: 172.16.0.220,3260] successful.
Nov 10 19:21:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df6ace3-5824-4d80-8bbc-e6802d7d9b90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c52d6c9-784a-4a1b-a285-6b71695f48c5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] <== disconnect_volume: return (321ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:21:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:21:43 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lazy-loading 'flavor' on Instance uuid 5ca3830d-1edf-4638-a5cf-6cf6efe37362 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:21:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1923992-ffa8-4f1c-a822-c133c9345b38 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.093s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:21:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:21:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:22:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:22:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Skipping network cache update for instance because it is Building. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 19:22:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:04 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:22:04 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:22:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:22:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:22:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:22:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:22:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:22:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 req-cf31108a-46ea-4c00-85eb-2e20807d9b69 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received event volume-reimaged-277e5d4b-3d2c-487d-9525-c2152138cb88 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 req-cf31108a-46ea-4c00-85eb-2e20807d9b69 service nova] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 req-cf31108a-46ea-4c00-85eb-2e20807d9b69 service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 req-cf31108a-46ea-4c00-85eb-2e20807d9b69 service nova] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-ce46698d-07ee-49bd-9e89-3b8d3cae7d15 req-cf31108a-46ea-4c00-85eb-2e20807d9b69 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Processing event volume-reimaged-277e5d4b-3d2c-487d-9525-c2152138cb88 {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:22:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:22:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8014MB free_disk=25.660511016845703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Applying migration context for instance 01641144-84e2-49f1-9d09-6a15a9f42249 as it has an incoming, in-progress migration 2101dbc2-59a6-45e3-82a1-4d5d9e6619ef. Migration status is finished {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 19:22:09 user nova-compute[75026]: INFO nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating resource usage from migration 2101dbc2-59a6-45e3-82a1-4d5d9e6619ef
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance d57c5ada-750c-41af-a14c-6546374cf5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f86437d3-8401-4c25-8122-1dcb98c1cd19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e220bb5d-26bb-4939-a635-ba5d946e7657 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Migration 2101dbc2-59a6-45e3-82a1-4d5d9e6619ef is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:22:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "81632714-289b-469d-a950-55177e8da002" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "81632714-289b-469d-a950-55177e8da002" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:22:10 user nova-compute[75026]: INFO nova.compute.claims [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Claim successful on node user
Nov 10 19:22:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:22:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.policy [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87425e99fab14d518648ac5d5ffd1477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b56289216442ea891dd09bd4fb4c2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:22:11 user nova-compute[75026]: INFO nova.compute.manager [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Terminating instance
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:22:11 user nova-compute[75026]: INFO nova.virt.block_device [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Booting with volume 3d7334ee-4cf5-4a1f-9bf1-774487ea757f at /dev/vda
Nov 10 19:22:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG os_brick.utils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc52dc7-c343-49e9-bb22-9ad1653cd4de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e10ea02-e2c9-4962-9660-751e1e354e0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cf17b4-420a-48c6-8f80-fbd149da30f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8544d3-f996-4d78-8291-fb3fb348948b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:22:11 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2baa82-5fac-4ec2-ae7e-c5908cf8af14]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG os_brick.utils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Updating existing volume attachment record: 44de7b00-56ef-450d-986b-c6b200e28b5f {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-8a6c4950-34f6-4f2e-8521-c20e65b1d059 req-15ee4579-cd26-497b-a922-0029c1a837a0 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-unplugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a6c4950-34f6-4f2e-8521-c20e65b1d059 req-15ee4579-cd26-497b-a922-0029c1a837a0 service nova] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a6c4950-34f6-4f2e-8521-c20e65b1d059 req-15ee4579-cd26-497b-a922-0029c1a837a0 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a6c4950-34f6-4f2e-8521-c20e65b1d059 req-15ee4579-cd26-497b-a922-0029c1a837a0 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-8a6c4950-34f6-4f2e-8521-c20e65b1d059 req-15ee4579-cd26-497b-a922-0029c1a837a0 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] No waiting events found dispatching network-vif-unplugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:22:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-8a6c4950-34f6-4f2e-8521-c20e65b1d059 req-15ee4579-cd26-497b-a922-0029c1a837a0 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-unplugged-090d3b60-38f6-47b6-84e4-1765dac2017e for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Instance destroyed successfully.
Nov 10 19:22:12 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lazy-loading 'resources' on Instance uuid 5ca3830d-1edf-4638-a5cf-6cf6efe37362 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-74805575',display_name='tempest-TestVolumeSwap-server-74805575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-74805575',id=8,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmeq3t6czW/NihO5uZqv9Mxc4mj1Gq5oHqGqSB36IVM6ogtWoZRjBTNsvLmZM+hcf0VO69s7LuMgmowJOfKQb1wW2COPaGQIKxy0KKLxq/M1gp1Y5cUIlZKbr+6QRu/qg==',key_name='tempest-keypair-533869735',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4febdd151ece434e8b87c2e8d58eca28',ramdisk_id='',reservation_id='r-b9atb19p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1859752726',owner_user_name='tempest-TestVolumeSwap-1859752726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e55eb3c65140088f483bfcdedf8e62',uuid=5ca3830d-1edf-4638-a5cf-6cf6efe37362,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Converting VIF {"id": "090d3b60-38f6-47b6-84e4-1765dac2017e", "address": "fa:16:3e:4f:c1:db", "network": {"id": "4da57252-b5af-4e2c-8591-14a2c2eb979f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1898758755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4febdd151ece434e8b87c2e8d58eca28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090d3b60-38", "ovs_interfaceid": "090d3b60-38f6-47b6-84e4-1765dac2017e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c1:db,bridge_name='br-int',has_traffic_filtering=True,id=090d3b60-38f6-47b6-84e4-1765dac2017e,network=Network(4da57252-b5af-4e2c-8591-14a2c2eb979f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090d3b60-38') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG os_vif [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c1:db,bridge_name='br-int',has_traffic_filtering=True,id=090d3b60-38f6-47b6-84e4-1765dac2017e,network=Network(4da57252-b5af-4e2c-8591-14a2c2eb979f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090d3b60-38') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap090d3b60-38, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e789459-2919-4bef-9ad8-077d524a0ef3) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:12 user nova-compute[75026]: INFO os_vif [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c1:db,bridge_name='br-int',has_traffic_filtering=True,id=090d3b60-38f6-47b6-84e4-1765dac2017e,network=Network(4da57252-b5af-4e2c-8591-14a2c2eb979f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090d3b60-38')
Nov 10 19:22:12 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Deleting instance files /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362_del
Nov 10 19:22:12 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Deletion of /opt/stack/data/nova/instances/5ca3830d-1edf-4638-a5cf-6cf6efe37362_del complete
Nov 10 19:22:12 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully created port: 16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:22:12 user nova-compute[75026]: INFO nova.compute.manager [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 10 19:22:12 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:22:12 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:22:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully created port: 69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:22:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:13 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:13 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Took 1.40 seconds to deallocate network for instance.
Nov 10 19:22:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-88b48f34-ac19-4875-8664-3194dfc227c4 req-33bae963-bca5-4085-9c16-9da6cc9be7b5 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-deleted-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully created port: 00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] No waiting events found dispatching network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:22:14 user nova-compute[75026]: WARNING nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received unexpected event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e for instance with vm_state active and task_state deleting.
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] No waiting events found dispatching network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:22:14 user nova-compute[75026]: WARNING nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received unexpected event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e for instance with vm_state active and task_state deleting.
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] No waiting events found dispatching network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:22:14 user nova-compute[75026]: WARNING nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received unexpected event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e for instance with vm_state active and task_state deleting.
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-unplugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] No waiting events found dispatching network-vif-unplugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-unplugged-090d3b60-38f6-47b6-84e4-1765dac2017e for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Acquiring lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] No waiting events found dispatching network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:22:14 user nova-compute[75026]: WARNING nova.compute.manager [req-8ab16cab-bbc7-41c7-823b-bd6ff474b70d req-ff8b56fb-9ed0-4a59-bc62-030a4d1eca99 service nova] [instance: 5ca3830d-1edf-4638-a5cf-6cf6efe37362] Received unexpected event network-vif-plugged-090d3b60-38f6-47b6-84e4-1765dac2017e for instance with vm_state active and task_state deleting.
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:14 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Deleted allocations for instance 5ca3830d-1edf-4638-a5cf-6cf6efe37362
Nov 10 19:22:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5cc6aa14-d72c-450c-987d-82397df7d815 tempest-TestVolumeSwap-1859752726 tempest-TestVolumeSwap-1859752726-project-member] Lock "5ca3830d-1edf-4638-a5cf-6cf6efe37362" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.080s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully created port: f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:22:15 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully created port: 7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:22:16 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully updated port: 16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:22:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-7b9af816-1607-4a6a-a7b5-174d9f22a94f req-6ee5352a-de54-4466-bd6d-0bd1f1484707 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-changed-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-7b9af816-1607-4a6a-a7b5-174d9f22a94f req-6ee5352a-de54-4466-bd6d-0bd1f1484707 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing instance network info cache due to event network-changed-16e124c7-2ea9-4337-9d56-62d8bea0431a. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:22:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7b9af816-1607-4a6a-a7b5-174d9f22a94f req-6ee5352a-de54-4466-bd6d-0bd1f1484707 service nova] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7b9af816-1607-4a6a-a7b5-174d9f22a94f req-6ee5352a-de54-4466-bd6d-0bd1f1484707 service nova] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-7b9af816-1607-4a6a-a7b5-174d9f22a94f req-6ee5352a-de54-4466-bd6d-0bd1f1484707 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing network info cache for port 16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:22:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-7b9af816-1607-4a6a-a7b5-174d9f22a94f req-6ee5352a-de54-4466-bd6d-0bd1f1484707 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:22:16 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully updated port: c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:22:17 user nova-compute[75026]: DEBUG nova.network.neutron [req-7b9af816-1607-4a6a-a7b5-174d9f22a94f req-6ee5352a-de54-4466-bd6d-0bd1f1484707 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7b9af816-1607-4a6a-a7b5-174d9f22a94f req-6ee5352a-de54-4466-bd6d-0bd1f1484707 service nova] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:17 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully updated port: 4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-changed-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing instance network info cache due to event network-changed-c07ef6df-4bdd-462f-8830-62315eff1120. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.network.neutron [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing network info cache for port c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully updated port: 69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.network.neutron [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.network.neutron [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-changed-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing instance network info cache due to event network-changed-4be4ceac-647c-47f9-b45d-f6328bd93528. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.network.neutron [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing network info cache for port 4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:22:18 user nova-compute[75026]: DEBUG nova.network.neutron [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:22:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0cc5e4ea-2236-4387-a365-5f0319086bf5 req-e031f12a-6cb2-4a71-b41d-d61a45ed9987 service nova] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:19 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully updated port: 00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-changed-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing instance network info cache due to event network-changed-69944cbd-fa51-494a-ad15-fd84fa1d2cc1. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.network.neutron [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing network info cache for port 69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Port acc7927d-7433-4d3b-a371-9b1433e46ee1 binding to destination host user is already ACTIVE {{(pid=75026) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.network.neutron [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully updated port: f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.network.neutron [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-changed-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing instance network info cache due to event network-changed-00869544-9765-46a7-8c86-382d13a0437b. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.network.neutron [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing network info cache for port 00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Creating tmpfile /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/tmpflcmoduh to verify with other compute node that the instance is on the same shared storage. {{(pid=75026) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.network.neutron [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-792584da-e8a3-49d1-9edd-84288d9df510 req-507ffba2-ce48-4bb9-b1ea-bc2bccd1d480 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-792584da-e8a3-49d1-9edd-84288d9df510 req-507ffba2-ce48-4bb9-b1ea-bc2bccd1d480 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-792584da-e8a3-49d1-9edd-84288d9df510 req-507ffba2-ce48-4bb9-b1ea-bc2bccd1d480 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-792584da-e8a3-49d1-9edd-84288d9df510 req-507ffba2-ce48-4bb9-b1ea-bc2bccd1d480 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-792584da-e8a3-49d1-9edd-84288d9df510 req-507ffba2-ce48-4bb9-b1ea-bc2bccd1d480 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:22:21 user nova-compute[75026]: WARNING nova.compute.manager [req-792584da-e8a3-49d1-9edd-84288d9df510 req-507ffba2-ce48-4bb9-b1ea-bc2bccd1d480 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state resized and task_state resize_reverting.
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.network.neutron [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d3c72064-1a7f-4b5c-b4f2-81e6090b7ebe req-4f5ff1e2-419e-4993-a055-f996d6602ec0 service nova] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance destroyed successfully.
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.objects.instance [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lazy-loading 'resources' on Instance uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:21:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_vif [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc7927d-74, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52de2362-8bee-4480-90a9-17251d46baa5) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:21 user nova-compute[75026]: INFO os_vif [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74')
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:22:21 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a463c610-cc67-4784-9740-4abcc653d4af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:22:21 user nova-compute[75026]: No targets found.
Nov 10 19:22:21 user nova-compute[75026]: iSNS:
Nov 10 19:22:21 user nova-compute[75026]: No targets found.
Nov 10 19:22:21 user nova-compute[75026]: STATIC:
Nov 10 19:22:21 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:22:21 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:22:21 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:22:21 user nova-compute[75026]: FIRMWARE:
Nov 10 19:22:21 user nova-compute[75026]: No targets found.
Nov 10 19:22:21 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:22:21 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:22:21 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f320b8c5-a28f-4c86-ab3a-cdf59dcbcfc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[512f8969-344b-43d6-ae00-9293c805be74]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:22:21 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:22:21 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed80424ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Successfully updated port: 7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bce088-81e1-4fa9-b767-68a3feab6e9b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[583b7b64-e042-4f6f-9735-355759b2ad59]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e15dfb9-ff9a-4c2a-9398-3c18c800d3b1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:22:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db27df4-2fc8-4459-a8c9-a5f7bbf864a1]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[92621b36-e8b2-4063-bcc1-30a873419d1f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c42f9d-7c6f-47e5-9b7c-48aa0fa7da94]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]
Nov 10 19:22:22 user nova-compute[75026]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.
Nov 10 19:22:22 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcb7931-802f-483f-914d-5a6a77421f90]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== disconnect_volume: return (322ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-changed-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing instance network info cache due to event network-changed-f4ea19cf-911c-4337-8a7c-e4bfea3417f5. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:22:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-1b268624-6f12-46b2-adbb-acf4405b4375 req-61de1d52-471d-4fdb-822b-c7d0745a2c78 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b268624-6f12-46b2-adbb-acf4405b4375 req-61de1d52-471d-4fdb-822b-c7d0745a2c78 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b268624-6f12-46b2-adbb-acf4405b4375 req-61de1d52-471d-4fdb-822b-c7d0745a2c78 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b268624-6f12-46b2-adbb-acf4405b4375 req-61de1d52-471d-4fdb-822b-c7d0745a2c78 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-1b268624-6f12-46b2-adbb-acf4405b4375 req-61de1d52-471d-4fdb-822b-c7d0745a2c78 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:22:23 user nova-compute[75026]: WARNING nova.compute.manager [req-1b268624-6f12-46b2-adbb-acf4405b4375 req-61de1d52-471d-4fdb-822b-c7d0745a2c78 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state resized and task_state resize_reverting.
Nov 10 19:22:23 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [{"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Instance network_info: |[{"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:23 user nova-compute[75026]: DEBUG nova.network.neutron [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing network info cache for port f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG nova.network.neutron [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updated VIF entry in instance network info cache for port f4ea19cf-911c-4337-8a7c-e4bfea3417f5. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG nova.network.neutron [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [{"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-changed-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing instance network info cache due to event network-changed-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG nova.network.neutron [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing network info cache for port 7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG nova.network.neutron [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updated VIF entry in instance network info cache for port 7f71ce16-64dc-41a0-bf60-e0afb8b6efe9. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG nova.network.neutron [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [{"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1eddb3a4-9b6b-4704-9c2a-baf3c22ec815 req-254060bc-b260-45b4-be51-032561375d8d service nova] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFoMTLzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:22:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:22:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:22:25 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9ee906-4c05-4940-9d34-35d2cb34a543]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:22:25 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e4c4f-876f-4f0e-b7b5-6cf50381df6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02] added
Nov 10 19:22:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b4792-b9fd-40ff-965d-c6309c0b2111]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2862b186-e136-405a-aae7-1187a3979ed8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFoMTLzE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:25 user nova-compute[75026]: INFO nova.virt.block_device [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Booting with volume a23eb6b9-10b2-4ff1-aac9-c12961105a89 at /dev/vdb
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFoMTLzE" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca671f0-5fa7-4e9b-9c79-1ad2eeaaab15]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFoMTLzE'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b5e5d-1d34-4e24-970b-b5df905865ed]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe41b5b-acac-4f79-ba6a-15c028fd1a69]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:22:26 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:22:26 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:22:26 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:22:26 user nova-compute[75026]: 
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b9d30-96f1-4bde-b2d7-9811129eaba2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02, portal: 172.16.0.220,3260]
Nov 10 19:22:26 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02, portal: 172.16.0.220,3260] successful.
Nov 10 19:22:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40aee5b-fdae-469e-b0ab-8995996d32ce]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d83a75-307b-40c0-bd5c-3295167538fa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)
Nov 10 19:22:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)
Nov 10 19:22:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835771a-b679-4e1e-b9f8-2abd6ad3cd42]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFoMTLzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.utils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1af97a-c21e-4be9-bb3f-c171226f0b7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[127caab6-394e-4cd7-9a75-f22e0cd76a99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a497b68e-011c-4f1a-89ab-016f9e80f2cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a57015d-543d-4993-ae85-3296f1ca8537]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:22:26 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:22:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5910a56-4d5e-477d-a1e2-f24a4ee6bf99]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG os_brick.utils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating existing volume attachment record: fd42d726-0e36-4beb-b305-c61da6cd1733 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:22:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23937323162363636', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937323162363636', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lazy-loading 'flavor' on Instance uuid f86437d3-8401-4c25-8122-1dcb98c1cd19 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:22:27 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:22:27 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:22:27 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:22:27 user nova-compute[75026]:   <serial>5cbb2669-a8f5-44f3-a67e-512255271d02</serial>
Nov 10 19:22:27 user nova-compute[75026]: </disk>
Nov 10 19:22:27 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] No VIF found with MAC fa:16:3e:56:fc:ef, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.objects.instance [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lazy-loading 'migration_context' on Instance uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.objects.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Object Instance<01641144-84e2-49f1-9d09-6a15a9f42249> lazy-loaded attributes: resources,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:22:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:22:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd042de0-5800-4696-9980-928f00a971be tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.226s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:28 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:22:28 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:22:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.653s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:28 user nova-compute[75026]: INFO nova.compute.manager [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Swapping old allocation on dict_keys(['0f7a5134-86ad-47cc-91e0-39a40ebb3a90']) held by migration 2101dbc2-59a6-45e3-82a1-4d5d9e6619ef for instance
Nov 10 19:22:28 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Overwriting current allocation {'allocations': {'0f7a5134-86ad-47cc-91e0-39a40ebb3a90': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 19}}, 'project_id': '49d22011dbaa43728771bc3d1eefaa30', 'user_id': 'c3955d2948c446c8b555fb7fea429581', 'consumer_generation': 1} on consumer 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 10 19:22:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:22:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquired lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:22:28 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Releasing lock "refresh_cache-01641144-84e2-49f1-9d09-6a15a9f42249" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG os_brick.utils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f17a10-0130-4aee-a324-5b523379fc9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fb6200-71b4-41cb-b269-727de61163bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[db623ded-acb2-4910-92de-a5022ac93c91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f29a9eb-27ce-43da-a832-ccfcf602c8a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:22:29 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:22:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecfd0f2-375f-4d53-a0c1-4a323d558671]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:22:29 user nova-compute[75026]: DEBUG os_brick.utils [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:22:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:22:38 user nova-compute[75026]: WARNING nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] While synchronizing instance power states, found 8 instances in the database and 4 instances on the hypervisor.
Nov 10 19:22:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 31abf353-32fa-4b39-a2b3-02b63976b997 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid d57c5ada-750c-41af-a14c-6546374cf5d2 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid f86437d3-8401-4c25-8122-1dcb98c1cd19 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid e220bb5d-26bb-4939-a635-ba5d946e7657 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 81632714-289b-469d-a950-55177e8da002 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 0c42552f-3882-4f34-bf6a-fdef6a69e785 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:38 user nova-compute[75026]: INFO nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "31abf353-32fa-4b39-a2b3-02b63976b997" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "31abf353-32fa-4b39-a2b3-02b63976b997" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "81632714-289b-469d-a950-55177e8da002" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "31abf353-32fa-4b39-a2b3-02b63976b997" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:38 user nova-compute[75026]: INFO nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 10 19:22:38 user nova-compute[75026]: WARNING nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Instance is unexpectedly not found. Ignore.
Nov 10 19:22:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:22:39 user nova-compute[75026]: INFO nova.virt.block_device [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Booting with volume 94378a27-6898-4d77-9e0d-fa136aad1fe2 at /dev/vdb
Nov 10 19:22:40 user nova-compute[75026]: DEBUG os_brick.utils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd16fc84-199e-434e-84d0-b91124f85bae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[07578948-4334-45ab-992a-d6ad81e1520e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5dab98-8c62-4304-bfa6-ebc160e4c436]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6853c7c-ded9-4817-b38a-bcf83a179203]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:22:40 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ee4ef-bf80-4057-93cc-52cc8e58b8f9]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG os_brick.utils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Updating existing volume attachment record: 2bd57958-6277-42d9-b0a7-d9d206c9a152 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:22:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:22:40 user nova-compute[75026]: INFO nova.compute.manager [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Detaching volume 5cbb2669-a8f5-44f3-a67e-512255271d02
Nov 10 19:22:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:22:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:22:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:03 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:23:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:23:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:23:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updating instance_info_cache with network_info: [{"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-31abf353-32fa-4b39-a2b3-02b63976b997" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:23:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:23:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8352MB free_disk=25.67641830444336GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance d57c5ada-750c-41af-a14c-6546374cf5d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f86437d3-8401-4c25-8122-1dcb98c1cd19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e220bb5d-26bb-4939-a635-ba5d946e7657 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 81632714-289b-469d-a950-55177e8da002 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:23:09 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:23:10 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:23:10 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:23:10 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:23:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:23:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:23:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:23:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:17 user nova-compute[75026]: INFO nova.compute.manager [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Terminating instance
Nov 10 19:23:17 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:17 user nova-compute[75026]: INFO nova.virt.block_device [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Attempting to driver detach volume 5cbb2669-a8f5-44f3-a67e-512255271d02 from mountpoint /dev/vdb
Nov 10 19:23:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Attempting to detach device vdb from instance f86437d3-8401-4c25-8122-1dcb98c1cd19 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:23:17 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:23:17 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:23:17 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:23:17 user nova-compute[75026]:   <serial>5cbb2669-a8f5-44f3-a67e-512255271d02</serial>
Nov 10 19:23:17 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:23:17 user nova-compute[75026]: </disk>
Nov 10 19:23:17 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-29b85b5c-5905-452e-af15-3243e42033f8 req-6ffd5152-68ac-47a5-bf6d-729808c1df9b service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-unplugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-29b85b5c-5905-452e-af15-3243e42033f8 req-6ffd5152-68ac-47a5-bf6d-729808c1df9b service nova] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-29b85b5c-5905-452e-af15-3243e42033f8 req-6ffd5152-68ac-47a5-bf6d-729808c1df9b service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-29b85b5c-5905-452e-af15-3243e42033f8 req-6ffd5152-68ac-47a5-bf6d-729808c1df9b service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-29b85b5c-5905-452e-af15-3243e42033f8 req-6ffd5152-68ac-47a5-bf6d-729808c1df9b service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] No waiting events found dispatching network-vif-unplugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-29b85b5c-5905-452e-af15-3243e42033f8 req-6ffd5152-68ac-47a5-bf6d-729808c1df9b service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-unplugged-90fe5a1f-83fe-41eb-8576-77be36d51234 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Successfully detached device vdb from instance f86437d3-8401-4c25-8122-1dcb98c1cd19 from the persistent domain config.
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f86437d3-8401-4c25-8122-1dcb98c1cd19 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:23:18 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:23:18 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:23:18 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:23:18 user nova-compute[75026]:   <serial>5cbb2669-a8f5-44f3-a67e-512255271d02</serial>
Nov 10 19:23:18 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:23:18 user nova-compute[75026]: </disk>
Nov 10 19:23:18 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:23:18 user nova-compute[75026]: INFO nova.virt.block_device [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Booting with volume 8cd886d4-c3da-4715-bf66-2cc2e13ad42d at /dev/vdc
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f86437d3-8401-4c25-8122-1dcb98c1cd19 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:23:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Instance destroyed successfully.
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lazy-loading 'resources' on Instance uuid e220bb5d-26bb-4939-a635-ba5d946e7657 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-132465',display_name='tempest-VolumesAdminNegativeTest-server-132465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-132465',id=13,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89956906ad1943408b1783771ee6aa32',ramdisk_id='',reservation_id='r-c1k407yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1994864820',owner_user_name='tempest-VolumesAdminNegativeTest-1994864820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:20:19Z,user_data=None,user_id='f2f78c518af14d6e84894f850811426b',uuid=e220bb5d-26bb-4939-a635-ba5d946e7657,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converting VIF {"id": "90fe5a1f-83fe-41eb-8576-77be36d51234", "address": "fa:16:3e:5b:28:b1", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90fe5a1f-83", "ovs_interfaceid": "90fe5a1f-83fe-41eb-8576-77be36d51234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:28:b1,bridge_name='br-int',has_traffic_filtering=True,id=90fe5a1f-83fe-41eb-8576-77be36d51234,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fe5a1f-83') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG os_vif [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:28:b1,bridge_name='br-int',has_traffic_filtering=True,id=90fe5a1f-83fe-41eb-8576-77be36d51234,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fe5a1f-83') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90fe5a1f-83, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28c36a95-958c-4ea9-9058-044db8d2985e) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:23:18 user nova-compute[75026]: INFO os_vif [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:28:b1,bridge_name='br-int',has_traffic_filtering=True,id=90fe5a1f-83fe-41eb-8576-77be36d51234,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90fe5a1f-83')
Nov 10 19:23:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Deleting instance files /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657_del
Nov 10 19:23:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Deletion of /opt/stack/data/nova/instances/e220bb5d-26bb-4939-a635-ba5d946e7657_del complete
Nov 10 19:23:18 user nova-compute[75026]: INFO nova.compute.manager [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 10 19:23:18 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG os_brick.utils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e41e47-18e1-4d77-b6e9-93a877908bad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa1907e-574f-4f93-b6e6-8acb41493b26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccfbe49-8496-4597-95c2-c3f5169d26eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b46ce2-d5b0-435c-9532-291ab485b4d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:23:19 user nova-compute[75026]: INFO nova.virt.block_device [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Booting with volume 1b3f4033-c186-4a8c-ae63-2b2c914dc765 at /dev/vdc
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:23:19 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f77245-17b0-4690-a8d5-e7bb1bda51dc]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.utils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Updating existing volume attachment record: 5d87d7a3-ff20-4886-bb3b-919f0dd5eb5a {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Starting finish_revert_migration {{(pid=75026) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Start _get_guest_xml network_info=[{"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '6219e5ef-cefe-4b75-bdf8-b903eed6c2cd', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '01641144-84e2-49f1-9d09-6a15a9f42249', 'attached_at': '2023-11-10T19:23:19.000000', 'detached_at': '', 'volume_id': '8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'serial': '8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:23:19 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:23:19 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.utils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.objects.instance [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a94c4be-b5ff-4bac-85c1-d25c9839b534]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:23:19 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:23:19 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:23:19 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b6354-4eea-4636-b8a9-5680972e70d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da37544c-879a-4dda-97fd-c6b8732817a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:23:19 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f75d3fe-5708-4e39-a07a-64c7b31b53eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad0bef4-039c-4345-87b2-e2b5f754e892]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7097fcd8-786d-4430-a7f0-30f2d8b7f3a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab] added
Nov 10 19:23:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:23:19 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bfdf99-49c5-4bb7-9c07-6b685016d7c2]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.utils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating existing volume attachment record: 3145e1a7-666d-4417-959c-1237e671fc46 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3fbe0-69e0-45d2-8918-90ca7df73c7e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3025af2-67d3-41bc-9906-b573ea64ddaa]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymdNOxet {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymdNOxet" returned: 0 in 0.041s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee76dc7-9520-4217-88ac-00c0cf5d89ca]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ymdNOxet'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7188747c-a463-45a2-9524-577ede404134]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd0b15f-58f6-4772-8495-d50164fb05ea]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)
Nov 10 19:23:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)
Nov 10 19:23:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Took 0.71 seconds to deallocate network for instance.
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ca3d5-a28b-4156-b4f5-8d4d51e64cba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]
Nov 10 19:23:19 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.
Nov 10 19:23:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[41167b27-7a71-4b1f-bfe9-23b3859d27e7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f274715c-b8fe-4a03-886c-78219e08b8c8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)
Nov 10 19:23:19 user nova-compute[75026]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:23:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)
Nov 10 19:23:19 user nova-compute[75026]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:23:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7c181d-4216-4244-aa99-386ac7154d71]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:19 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Deleted allocations for instance e220bb5d-26bb-4939-a635-ba5d946e7657
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] No waiting events found dispatching network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:23:20 user nova-compute[75026]: WARNING nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received unexpected event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 for instance with vm_state deleted and task_state None.
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] No waiting events found dispatching network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:23:20 user nova-compute[75026]: WARNING nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received unexpected event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 for instance with vm_state deleted and task_state None.
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] No waiting events found dispatching network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:23:20 user nova-compute[75026]: WARNING nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received unexpected event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 for instance with vm_state deleted and task_state None.
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-unplugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] No waiting events found dispatching network-vif-unplugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:23:20 user nova-compute[75026]: WARNING nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received unexpected event network-vif-unplugged-90fe5a1f-83fe-41eb-8576-77be36d51234 for instance with vm_state deleted and task_state None.
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Acquiring lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] No waiting events found dispatching network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:23:20 user nova-compute[75026]: WARNING nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received unexpected event network-vif-plugged-90fe5a1f-83fe-41eb-8576-77be36d51234 for instance with vm_state deleted and task_state None.
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-b518b298-2044-4046-bf99-01f256554eb6 req-eade2b7e-c6b3-4c90-a7a6-c8fe18dc2bd1 service nova] [instance: e220bb5d-26bb-4939-a635-ba5d946e7657] Received event network-vif-deleted-90fe5a1f-83fe-41eb-8576-77be36d51234 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5d4dede9-53d6-4415-b8df-64097c9a40ad tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "e220bb5d-26bb-4939-a635-ba5d946e7657" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23833346135626337', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833346135626337', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:21:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:22:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:23:20 user nova-compute[75026]:   <uuid>01641144-84e2-49f1-9d09-6a15a9f42249</uuid>
Nov 10 19:23:20 user nova-compute[75026]:   <name>instance-00000002</name>
Nov 10 19:23:20 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:23:20 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:23:20 user nova-compute[75026]:   <metadata>
Nov 10 19:23:20 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:23:20 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:23:20 user nova-compute[75026]:       <nova:name>tempest-ServerActionsTestOtherB-server-451439939</nova:name>
Nov 10 19:23:20 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:23:19</nova:creationTime>
Nov 10 19:23:20 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:23:20 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:23:20 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:23:20 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:23:20 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:23:20 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:23:20 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:23:20 user nova-compute[75026]:       <nova:owner>
Nov 10 19:23:20 user nova-compute[75026]:         <nova:user uuid="c3955d2948c446c8b555fb7fea429581">tempest-ServerActionsTestOtherB-1354094982-project-member</nova:user>
Nov 10 19:23:20 user nova-compute[75026]:         <nova:project uuid="49d22011dbaa43728771bc3d1eefaa30">tempest-ServerActionsTestOtherB-1354094982</nova:project>
Nov 10 19:23:20 user nova-compute[75026]:       </nova:owner>
Nov 10 19:23:20 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:23:20 user nova-compute[75026]:       <nova:ports>
Nov 10 19:23:20 user nova-compute[75026]:         <nova:port uuid="acc7927d-7433-4d3b-a371-9b1433e46ee1">
Nov 10 19:23:20 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:23:20 user nova-compute[75026]:         </nova:port>
Nov 10 19:23:20 user nova-compute[75026]:       </nova:ports>
Nov 10 19:23:20 user nova-compute[75026]:     </nova:instance>
Nov 10 19:23:20 user nova-compute[75026]:   </metadata>
Nov 10 19:23:20 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:23:20 user nova-compute[75026]:     <system>
Nov 10 19:23:20 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:23:20 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:23:20 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:23:20 user nova-compute[75026]:       <entry name="serial">01641144-84e2-49f1-9d09-6a15a9f42249</entry>
Nov 10 19:23:20 user nova-compute[75026]:       <entry name="uuid">01641144-84e2-49f1-9d09-6a15a9f42249</entry>
Nov 10 19:23:20 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:23:20 user nova-compute[75026]:     </system>
Nov 10 19:23:20 user nova-compute[75026]:   </sysinfo>
Nov 10 19:23:20 user nova-compute[75026]:   <os>
Nov 10 19:23:20 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:23:20 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:23:20 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:23:20 user nova-compute[75026]:   </os>
Nov 10 19:23:20 user nova-compute[75026]:   <features>
Nov 10 19:23:20 user nova-compute[75026]:     <acpi/>
Nov 10 19:23:20 user nova-compute[75026]:     <apic/>
Nov 10 19:23:20 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:23:20 user nova-compute[75026]:   </features>
Nov 10 19:23:20 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:23:20 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:23:20 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:23:20 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:23:20 user nova-compute[75026]:   </clock>
Nov 10 19:23:20 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:23:20 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:23:20 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:23:20 user nova-compute[75026]:   </cpu>
Nov 10 19:23:20 user nova-compute[75026]:   <devices>
Nov 10 19:23:20 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:23:20 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:23:20 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk"/>
Nov 10 19:23:20 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:23:20 user nova-compute[75026]:     </disk>
Nov 10 19:23:20 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:23:20 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:23:20 user nova-compute[75026]:       <source dev="/dev/sdc"/>
Nov 10 19:23:20 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:23:20 user nova-compute[75026]:       <serial>8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab</serial>
Nov 10 19:23:20 user nova-compute[75026]:     </disk>
Nov 10 19:23:20 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:23:20 user nova-compute[75026]:       <mac address="fa:16:3e:17:eb:e2"/>
Nov 10 19:23:20 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:23:20 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:23:20 user nova-compute[75026]:       <target dev="tapacc7927d-74"/>
Nov 10 19:23:20 user nova-compute[75026]:     </interface>
Nov 10 19:23:20 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:23:20 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/console.log" append="off"/>
Nov 10 19:23:20 user nova-compute[75026]:     </serial>
Nov 10 19:23:20 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:23:20 user nova-compute[75026]:     <video>
Nov 10 19:23:20 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:23:20 user nova-compute[75026]:     </video>
Nov 10 19:23:20 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:23:20 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:23:20 user nova-compute[75026]:     </rng>
Nov 10 19:23:20 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:23:20 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:23:20 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:23:20 user nova-compute[75026]:     </memballoon>
Nov 10 19:23:20 user nova-compute[75026]:   </devices>
Nov 10 19:23:20 user nova-compute[75026]: </domain>
Nov 10 19:23:20 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:21:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:22:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG os_vif [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b260c134-c22f-503e-9239-5058f034d778', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacc7927d-74, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacc7927d-74, col_values=(('qos', UUID('7eefdd02-2a3b-4b76-bd65-c057f11e3f4a')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacc7927d-74, col_values=(('external_ids', {'iface-id': 'acc7927d-7433-4d3b-a371-9b1433e46ee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:eb:e2', 'vm-uuid': '01641144-84e2-49f1-9d09-6a15a9f42249'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:20 user nova-compute[75026]: INFO os_vif [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74')
Nov 10 19:23:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-8670a2ab-d7d0-4298-8b7d-f355bd877bf7 req-4d387a84-1e43-4ddc-b3bf-9330459afe93 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8670a2ab-d7d0-4298-8b7d-f355bd877bf7 req-4d387a84-1e43-4ddc-b3bf-9330459afe93 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8670a2ab-d7d0-4298-8b7d-f355bd877bf7 req-4d387a84-1e43-4ddc-b3bf-9330459afe93 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8670a2ab-d7d0-4298-8b7d-f355bd877bf7 req-4d387a84-1e43-4ddc-b3bf-9330459afe93 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-8670a2ab-d7d0-4298-8b7d-f355bd877bf7 req-4d387a84-1e43-4ddc-b3bf-9330459afe93 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:23:22 user nova-compute[75026]: WARNING nova.compute.manager [req-8670a2ab-d7d0-4298-8b7d-f355bd877bf7 req-4d387a84-1e43-4ddc-b3bf-9330459afe93 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state resized and task_state resize_reverting.
Nov 10 19:23:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:23:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance running successfully.
Nov 10 19:23:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] finish_revert_migration finished successfully. {{(pid=75026) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 10 19:23:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-c24613fb-0ba8-40d6-a093-58a07bc3e75d req-05efd0c8-61be-44c4-bc41-0a4d3f084f0a service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:23:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c24613fb-0ba8-40d6-a093-58a07bc3e75d req-05efd0c8-61be-44c4-bc41-0a4d3f084f0a service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:23:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c24613fb-0ba8-40d6-a093-58a07bc3e75d req-05efd0c8-61be-44c4-bc41-0a4d3f084f0a service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:23:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c24613fb-0ba8-40d6-a093-58a07bc3e75d req-05efd0c8-61be-44c4-bc41-0a4d3f084f0a service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-c24613fb-0ba8-40d6-a093-58a07bc3e75d req-05efd0c8-61be-44c4-bc41-0a4d3f084f0a service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:23:24 user nova-compute[75026]: WARNING nova.compute.manager [req-c24613fb-0ba8-40d6-a093-58a07bc3e75d req-05efd0c8-61be-44c4-bc41-0a4d3f084f0a service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state resized and task_state resize_reverting.
Nov 10 19:23:24 user nova-compute[75026]: INFO nova.compute.manager [None req-9d24dc98-e6b0-42b7-a5f6-e6f29c88fc7e tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance to original state: 'active'
Nov 10 19:23:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f86437d3-8401-4c25-8122-1dcb98c1cd19 is timed out.
Nov 10 19:23:38 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Successfully detached device vdb from instance f86437d3-8401-4c25-8122-1dcb98c1cd19 from the live domain config.
Nov 10 19:23:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFoMTLzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:23:38 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6dc7bf-2782-4bfe-88d1-f5fd61df5bc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:23:38 user nova-compute[75026]: No targets found.
Nov 10 19:23:38 user nova-compute[75026]: iSNS:
Nov 10 19:23:38 user nova-compute[75026]: No targets found.
Nov 10 19:23:38 user nova-compute[75026]: STATIC:
Nov 10 19:23:38 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:23:38 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:23:38 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:23:38 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02
Nov 10 19:23:38 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:23:38 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:23:38 user nova-compute[75026]: FIRMWARE:
Nov 10 19:23:38 user nova-compute[75026]: No targets found.
Nov 10 19:23:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:23:38 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:23:38 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c7301a-b9d9-45a5-a30a-f88588030a17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[88209898-2a01-4463-a26e-4c818b60f962]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)
Nov 10 19:23:38 user nova-compute[75026]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:23:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 (non-flash)
Nov 10 19:23:38 user nova-compute[75026]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:23:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda01afd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e77ba11-306a-4c4b-8dca-807d0ed33386]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd09824-02e6-4625-a233-460a2877a75f]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[231d35c5-cc3c-476e-adc7-ba1eec1bef4e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d63259-6825-4554-8ee0-f16c261c6f09]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8359ae-0771-4e61-afef-0d3fe5d5ad66]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a37a890-f2c7-4434-836c-febbe7ca8e42]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02, portal: 172.16.0.220,3260]
Nov 10 19:23:38 user nova-compute[75026]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02, portal: 172.16.0.220,3260] successful.
Nov 10 19:23:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:23:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbb2669-a8f5-44f3-a67e-512255271d02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:23:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df6aa9-3022-4057-9bba-4360ba260cc5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:23:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:23:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:23:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] <== disconnect_volume: return (322ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:23:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:23:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:46 user nova-compute[75026]: DEBUG nova.objects.instance [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lazy-loading 'flavor' on Instance uuid f86437d3-8401-4c25-8122-1dcb98c1cd19 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:23:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0df60e57-e958-4551-a387-f35e2892ebc3 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 66.125s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:23:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:23:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:24:03 user nova-compute[75026]: INFO nova.compute.claims [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Claim successful on node user
Nov 10 19:24:03 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG nova.network.neutron [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:24:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:24:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG nova.policy [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a44857fb02f843df95883ee2b5daf3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a491b667d34c4a9f991e2d7d29099671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:24:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Creating image(s)
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "/opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "/opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.227s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk 1073741824" returned: 0 in 0.069s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.247s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.network.neutron [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Successfully created port: b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Cannot resize image /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Ensure instance console log exists: /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.network.neutron [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Successfully updated port: b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquired lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.network.neutron [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ea61307-0134-41d7-a1ad-842a84b8efc7 req-40fafc27-3ab1-482d-b54d-652622beeddf service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-changed-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-8ea61307-0134-41d7-a1ad-842a84b8efc7 req-40fafc27-3ab1-482d-b54d-652622beeddf service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Refreshing instance network info cache due to event network-changed-b04da179-c3e9-4063-b77f-2c8c8a43801f. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ea61307-0134-41d7-a1ad-842a84b8efc7 req-40fafc27-3ab1-482d-b54d-652622beeddf service nova] Acquiring lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:24:05 user nova-compute[75026]: DEBUG nova.network.neutron [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updating instance_info_cache with network_info: [{"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Releasing lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Instance network_info: |[{"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ea61307-0134-41d7-a1ad-842a84b8efc7 req-40fafc27-3ab1-482d-b54d-652622beeddf service nova] Acquired lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.network.neutron [req-8ea61307-0134-41d7-a1ad-842a84b8efc7 req-40fafc27-3ab1-482d-b54d-652622beeddf service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Refreshing network info cache for port b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Start _get_guest_xml network_info=[{"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:24:06 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:06 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-727980199',display_name='tempest-AttachVolumeNegativeTest-server-727980199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-727980199',id=16,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNySllGVspGFUsFIww9ntxk1YrtYnUjdXDUvmYoB2LW/fCNmtyCpSE1sy8Y5a7LqYy9AWuTALLifvMjJwDV9P5wIWZ2iinROD+52H3JGrKY859L82JcvYv3hAWlm7Ulp1A==',key_name='tempest-keypair-1206273795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-1h0g67ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=1cb42234-262e-4c9a-9b30-5315e07b5a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:55:30,bridge_name='br-int',has_traffic_filtering=True,id=b04da179-c3e9-4063-b77f-2c8c8a43801f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04da179-c3') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cb42234-262e-4c9a-9b30-5315e07b5a42 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:24:06 user nova-compute[75026]:   <uuid>1cb42234-262e-4c9a-9b30-5315e07b5a42</uuid>
Nov 10 19:24:06 user nova-compute[75026]:   <name>instance-00000010</name>
Nov 10 19:24:06 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:24:06 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:24:06 user nova-compute[75026]:   <metadata>
Nov 10 19:24:06 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:24:06 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:24:06 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeNegativeTest-server-727980199</nova:name>
Nov 10 19:24:06 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:24:06</nova:creationTime>
Nov 10 19:24:06 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:24:06 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:24:06 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:24:06 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:24:06 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:24:06 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:24:06 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:24:06 user nova-compute[75026]:       <nova:owner>
Nov 10 19:24:06 user nova-compute[75026]:         <nova:user uuid="a44857fb02f843df95883ee2b5daf3ce">tempest-AttachVolumeNegativeTest-1780662801-project-member</nova:user>
Nov 10 19:24:06 user nova-compute[75026]:         <nova:project uuid="a491b667d34c4a9f991e2d7d29099671">tempest-AttachVolumeNegativeTest-1780662801</nova:project>
Nov 10 19:24:06 user nova-compute[75026]:       </nova:owner>
Nov 10 19:24:06 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:24:06 user nova-compute[75026]:       <nova:ports>
Nov 10 19:24:06 user nova-compute[75026]:         <nova:port uuid="b04da179-c3e9-4063-b77f-2c8c8a43801f">
Nov 10 19:24:06 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:24:06 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:06 user nova-compute[75026]:       </nova:ports>
Nov 10 19:24:06 user nova-compute[75026]:     </nova:instance>
Nov 10 19:24:06 user nova-compute[75026]:   </metadata>
Nov 10 19:24:06 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:24:06 user nova-compute[75026]:     <system>
Nov 10 19:24:06 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:24:06 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:24:06 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:24:06 user nova-compute[75026]:       <entry name="serial">1cb42234-262e-4c9a-9b30-5315e07b5a42</entry>
Nov 10 19:24:06 user nova-compute[75026]:       <entry name="uuid">1cb42234-262e-4c9a-9b30-5315e07b5a42</entry>
Nov 10 19:24:06 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:24:06 user nova-compute[75026]:     </system>
Nov 10 19:24:06 user nova-compute[75026]:   </sysinfo>
Nov 10 19:24:06 user nova-compute[75026]:   <os>
Nov 10 19:24:06 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:24:06 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:24:06 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:24:06 user nova-compute[75026]:   </os>
Nov 10 19:24:06 user nova-compute[75026]:   <features>
Nov 10 19:24:06 user nova-compute[75026]:     <acpi/>
Nov 10 19:24:06 user nova-compute[75026]:     <apic/>
Nov 10 19:24:06 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:24:06 user nova-compute[75026]:   </features>
Nov 10 19:24:06 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:24:06 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:24:06 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:24:06 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:24:06 user nova-compute[75026]:   </clock>
Nov 10 19:24:06 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:24:06 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:24:06 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:24:06 user nova-compute[75026]:   </cpu>
Nov 10 19:24:06 user nova-compute[75026]:   <devices>
Nov 10 19:24:06 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:24:06 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:24:06 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk"/>
Nov 10 19:24:06 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:24:06 user nova-compute[75026]:     </disk>
Nov 10 19:24:06 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:06 user nova-compute[75026]:       <mac address="fa:16:3e:ec:55:30"/>
Nov 10 19:24:06 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:06 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:06 user nova-compute[75026]:       <target dev="tapb04da179-c3"/>
Nov 10 19:24:06 user nova-compute[75026]:     </interface>
Nov 10 19:24:06 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:24:06 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/console.log" append="off"/>
Nov 10 19:24:06 user nova-compute[75026]:     </serial>
Nov 10 19:24:06 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:24:06 user nova-compute[75026]:     <video>
Nov 10 19:24:06 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:06 user nova-compute[75026]:     </video>
Nov 10 19:24:06 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:24:06 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:24:06 user nova-compute[75026]:     </rng>
Nov 10 19:24:06 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:24:06 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:24:06 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:24:06 user nova-compute[75026]:     </memballoon>
Nov 10 19:24:06 user nova-compute[75026]:   </devices>
Nov 10 19:24:06 user nova-compute[75026]: </domain>
Nov 10 19:24:06 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-727980199',display_name='tempest-AttachVolumeNegativeTest-server-727980199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-727980199',id=16,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNySllGVspGFUsFIww9ntxk1YrtYnUjdXDUvmYoB2LW/fCNmtyCpSE1sy8Y5a7LqYy9AWuTALLifvMjJwDV9P5wIWZ2iinROD+52H3JGrKY859L82JcvYv3hAWlm7Ulp1A==',key_name='tempest-keypair-1206273795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-1h0g67ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=1cb42234-262e-4c9a-9b30-5315e07b5a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:55:30,bridge_name='br-int',has_traffic_filtering=True,id=b04da179-c3e9-4063-b77f-2c8c8a43801f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04da179-c3') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG os_vif [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:55:30,bridge_name='br-int',has_traffic_filtering=True,id=b04da179-c3e9-4063-b77f-2c8c8a43801f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04da179-c3') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a390f42-be0e-54e6-b189-8184b7f476ef', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb04da179-c3, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb04da179-c3, col_values=(('qos', UUID('cdb68d60-59ca-40be-a85b-22c81353da8c')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb04da179-c3, col_values=(('external_ids', {'iface-id': 'b04da179-c3e9-4063-b77f-2c8c8a43801f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:55:30', 'vm-uuid': '1cb42234-262e-4c9a-9b30-5315e07b5a42'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:06 user nova-compute[75026]: INFO os_vif [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:55:30,bridge_name='br-int',has_traffic_filtering=True,id=b04da179-c3e9-4063-b77f-2c8c8a43801f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04da179-c3')
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No VIF found with MAC fa:16:3e:ec:55:30, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.network.neutron [req-8ea61307-0134-41d7-a1ad-842a84b8efc7 req-40fafc27-3ab1-482d-b54d-652622beeddf service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updated VIF entry in instance network info cache for port b04da179-c3e9-4063-b77f-2c8c8a43801f. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG nova.network.neutron [req-8ea61307-0134-41d7-a1ad-842a84b8efc7 req-40fafc27-3ab1-482d-b54d-652622beeddf service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updating instance_info_cache with network_info: [{"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8ea61307-0134-41d7-a1ad-842a84b8efc7 req-40fafc27-3ab1-482d-b54d-652622beeddf service nova] Releasing lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-bc836fd6-2243-4abe-83bd-0cd4078756a2 req-fc3114ce-24a5-489d-85ec-87588d904015 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bc836fd6-2243-4abe-83bd-0cd4078756a2 req-fc3114ce-24a5-489d-85ec-87588d904015 service nova] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bc836fd6-2243-4abe-83bd-0cd4078756a2 req-fc3114ce-24a5-489d-85ec-87588d904015 service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bc836fd6-2243-4abe-83bd-0cd4078756a2 req-fc3114ce-24a5-489d-85ec-87588d904015 service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-bc836fd6-2243-4abe-83bd-0cd4078756a2 req-fc3114ce-24a5-489d-85ec-87588d904015 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] No waiting events found dispatching network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:07 user nova-compute[75026]: WARNING nova.compute.manager [req-bc836fd6-2243-4abe-83bd-0cd4078756a2 req-fc3114ce-24a5-489d-85ec-87588d904015 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received unexpected event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f for instance with vm_state building and task_state spawning.
Nov 10 19:24:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updating instance_info_cache with network_info: [{"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-d57c5ada-750c-41af-a14c-6546374cf5d2" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:08 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-33f6f109-5955-4ce6-a47c-c62d20a91d3d req-82cb046e-51d8-4453-8dc7-fdf09d556984 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-33f6f109-5955-4ce6-a47c-c62d20a91d3d req-82cb046e-51d8-4453-8dc7-fdf09d556984 service nova] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-33f6f109-5955-4ce6-a47c-c62d20a91d3d req-82cb046e-51d8-4453-8dc7-fdf09d556984 service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-33f6f109-5955-4ce6-a47c-c62d20a91d3d req-82cb046e-51d8-4453-8dc7-fdf09d556984 service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-33f6f109-5955-4ce6-a47c-c62d20a91d3d req-82cb046e-51d8-4453-8dc7-fdf09d556984 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] No waiting events found dispatching network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:10 user nova-compute[75026]: WARNING nova.compute.manager [req-33f6f109-5955-4ce6-a47c-c62d20a91d3d req-82cb046e-51d8-4453-8dc7-fdf09d556984 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received unexpected event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f for instance with vm_state building and task_state spawning.
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:24:10 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Instance spawned successfully.
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:10 user nova-compute[75026]: INFO nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 10 19:24:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:24:10 user nova-compute[75026]: INFO nova.compute.manager [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Took 7.04 seconds to build instance.
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ff7927ac-09df-416f-903a-270dbaad9ab9 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.132s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:11 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:11 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=25.727035522460938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance d57c5ada-750c-41af-a14c-6546374cf5d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f86437d3-8401-4c25-8122-1dcb98c1cd19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 81632714-289b-469d-a950-55177e8da002 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1cb42234-262e-4c9a-9b30-5315e07b5a42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:24:11 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:24:12 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:24:12 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:24:12 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:24:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:24:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:24:16 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Creating image(s)
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Ensure instance console log exists: /opt/stack/data/nova/instances/81632714-289b-469d-a950-55177e8da002/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Start _get_guest_xml network_info=[{"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '44de7b00-56ef-450d-986b-c6b200e28b5f', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wILUbrBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81632714-289b-469d-a950-55177e8da002', 'attached_at': '', 'detached_at': '', 'volume_id': '3d7334ee-4cf5-4a1f-9bf1-774487ea757f', 'serial': '3d7334ee-4cf5-4a1f-9bf1-774487ea757f'}, 'volume_type': None}, {'boot_index': 1, 'attachment_id': '2bd57958-6277-42d9-b0a7-d9d206c9a152', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbwSAoXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81632714-289b-469d-a950-55177e8da002', 'attached_at': '', 'detached_at': '', 'volume_id': '94378a27-6898-4d77-9e0d-fa136aad1fe2', 'serial': '94378a27-6898-4d77-9e0d-fa136aad1fe2'}, 'volume_type': None}, {'boot_index': 2, 'attachment_id': '5d87d7a3-ff20-4886-bb3b-919f0dd5eb5a', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbzwxhrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81632714-289b-469d-a950-55177e8da002', 'attached_at': '', 'detached_at': '', 'volume_id': '8cd886d4-c3da-4715-bf66-2cc2e13ad42d', 'serial': '8cd886d4-c3da-4715-bf66-2cc2e13ad42d'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:24:16 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:16 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wILUbrBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:24:16 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:16 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:16 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:24:16 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Creating image(s)
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Ensure instance console log exists: /opt/stack/data/nova/instances/c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Start _get_guest_xml network_info=[{"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '9617b26d-a372-4c0f-9a3a-13ccaf1624d9', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plhgHOQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a', 'attached_at': '', 'detached_at': '', 'volume_id': '5909e5b4-3695-4425-b3dd-9c6cb52328f8', 'serial': '5909e5b4-3695-4425-b3dd-9c6cb52328f8'}, 'volume_type': None}, {'boot_index': 1, 'attachment_id': 'fd42d726-0e36-4beb-b305-c61da6cd1733', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtIsmZik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a23eb6b9-10b2-4ff1-aac9-c12961105a89', 'serial': 'a23eb6b9-10b2-4ff1-aac9-c12961105a89'}, 'volume_type': None}, {'boot_index': 2, 'attachment_id': '3145e1a7-666d-4417-959c-1237e671fc46', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSCbAYze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a', 'attached_at': '', 'detached_at': '', 'volume_id': '1b3f4033-c186-4a8c-ae63-2b2c914dc765', 'serial': '1b3f4033-c186-4a8c-ae63-2b2c914dc765'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d839df4-4cc0-4108-a1bd-eccafd4aaa11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:24:16 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:16 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plhgHOQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:24:16 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab20e8bb-22c3-47cb-aa0b-ba51b911b78b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f] added
Nov 10 19:24:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1d616-777b-42ef-a7f1-3dfab35264b5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f756ff-27f5-4d25-9536-afd6f418fb1b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wILUbrBZ {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wILUbrBZ" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8c0da-34cb-4685-8054-01990deb6a8c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wILUbrBZ'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcf3500-1a6c-45ed-8b05-fbad6a45ea1d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac757c2b-1d64-4d89-a866-e16a1cd7e51a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16afc6ce-d3ae-4be9-84b3-79eb451f1ace]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f, portal: 172.16.0.220,3260]
Nov 10 19:24:16 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f, portal: 172.16.0.220,3260] successful.
Nov 10 19:24:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50206b83-7593-4b22-a5b3-d1b905f20a61]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b3eb66-11ae-41d6-8248-44333c1ea362]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:16 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:16 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:16 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b31b70-ccb9-4a9a-bf84-25d41e62f3c6]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wILUbrBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:24:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23235313331373564', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235313331373564', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.309s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:17 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:17 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ffcb09-ca7f-44e0-90a5-111e113317f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:24:17 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbwSAoXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:24:17 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[493cc681-d37d-42ab-bd87-f19265d7c3ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8] added
Nov 10 19:24:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[51214452-c2bf-46e8-a770-88e29a9a468c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3765811-d9b4-4e32-bd7d-1fe6847d68f1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v plhgHOQk {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v plhgHOQk" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cd6e00-428e-4548-89db-cf81d1fd6639]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'plhgHOQk'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4631cc5-76c0-4976-b2f9-fdc2b96327f3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe1204b-61f5-4c62-bbd5-76f657b0a62f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:17 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:17 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[836e2986-a479-4f3f-b577-db02e49c37c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8, portal: 172.16.0.220,3260]
Nov 10 19:24:17 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8, portal: 172.16.0.220,3260] successful.
Nov 10 19:24:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[141ea127-81c4-4a8b-9956-ff908de0452b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdc93c9-7153-4566-8c20-3ea84e39c280]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:17 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:17 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:17 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:17 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc42300-4344-4f66-bca9-3ac8a5cb8de5]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:24:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plhgHOQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== connect_volume: return (2667ms) {'type': 'block', 'scsi_wwn': '23266383239363734', 'path': '/dev/sdd'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266383239363734', 'path': '/dev/sdd'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.312s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:18 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ed00d-a233-498a-80ec-24bf75ccd042]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:24:18 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtIsmZik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:24:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e288ebf-01fb-4834-b4f8-c975f731055e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2] added
Nov 10 19:24:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6682e087-d21d-4aa9-a11a-193bd95ff318]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4122e522-f99e-418c-bc83-0546a87b6784]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbwSAoXf {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbwSAoXf" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f34cf2-10aa-494a-8747-84205c608189]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mbwSAoXf'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4415ae-cf56-4b15-8610-e558f034427c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb771085-4e1d-461a-a9d8-6c5ae3435b63]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02590045-c1f4-44ba-a24c-bace2ea44425]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2, portal: 172.16.0.220,3260]
Nov 10 19:24:19 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2, portal: 172.16.0.220,3260] successful.
Nov 10 19:24:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b59d58-4be6-4d83-a74b-4a59f84a0a8b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f694c8-a726-4760-9bec-081125947bec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:19 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d7cd87-0e15-4a81-81c4-a5a1781924e0]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbwSAoXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== connect_volume: return (2692ms) {'type': 'block', 'scsi_wwn': '23161336132636166', 'path': '/dev/sde'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161336132636166', 'path': '/dev/sde'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.349s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:20 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:20 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0660c12c-3624-4d1f-bd02-988c349e5fdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:24:20 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbzwxhrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:24:20 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b786f6b-5831-40aa-9aab-6d5488e032ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89] added
Nov 10 19:24:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7f952-43f9-48bb-ae5a-af8eb845e228]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56eaf52-53f2-4364-a06d-1bf1fa5bfeaf]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qtIsmZik {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qtIsmZik" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5fb6fc-2b01-4dcc-8df2-07f65e0d9d7b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qtIsmZik'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3d1dd1-37e1-43d2-8b53-e42227a29149]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2956deed-4bdd-45e5-8d47-50494ef8ca98]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef9146-edb0-4fef-a43e-1aeba2e8c9bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89, portal: 172.16.0.220,3260]
Nov 10 19:24:20 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89, portal: 172.16.0.220,3260] successful.
Nov 10 19:24:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc75b3a-51fd-49c2-b57a-73bec52e04b6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1ecd9f-3168-4b4c-8a10-c7a79b2b1839]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b06bee-7a84-4c0d-bccd-f9ca96cd9e4d]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:24:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtIsmZik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== connect_volume: return (2677ms) {'type': 'block', 'scsi_wwn': '26265343661323435', 'path': '/dev/sdf'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265343661323435', 'path': '/dev/sdf'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.291s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:21 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:21 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d844925a-58d1-4a0d-b242-b46f4399dace]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:24:21 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSCbAYze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:24:21 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0628be65-8a37-4bbb-9700-e042f88f5bc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d] added
Nov 10 19:24:21 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6475049e-a7a7-4ddd-92f2-aa24040dfc85]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[050c6727-8434-46b6-9a35-aaab25e1224f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbzwxhrB {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbzwxhrB" returned: 0 in 0.049s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da351ef8-f317-424e-a46d-dff11f5a51ff]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nbzwxhrB'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.120s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[06537d31-6f7b-4b2c-9673-bf6193305619]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[197855c8-9631-45f7-a820-d85f55e6bc1a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:21 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:21 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:21 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:21 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:21 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:21 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:21 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:21 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:21 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:21 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0dcd54-2e0d-4a3a-9cf1-b556a0469618]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d, portal: 172.16.0.220,3260]
Nov 10 19:24:22 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d, portal: 172.16.0.220,3260] successful.
Nov 10 19:24:22 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fda5745-d12f-451f-90d2-46a9a1659bbe]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2f6ea7-e211-4e17-8108-f35af2257952]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:24:22 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:22 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:24:22 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.510s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:22 user nova-compute[75026]: INFO nova.compute.manager [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Terminating instance
Nov 10 19:24:22 user nova-compute[75026]: DEBUG nova.compute.manager [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9f6a00-61fd-4d9a-952f-b7bd3ae48a3d]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbzwxhrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-d82bfeeb-eded-4181-a988-532d8ceb698e req-0a0fe886-7aae-4dec-b861-8a755cf4564b service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received event network-vif-unplugged-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d82bfeeb-eded-4181-a988-532d8ceb698e req-0a0fe886-7aae-4dec-b861-8a755cf4564b service nova] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d82bfeeb-eded-4181-a988-532d8ceb698e req-0a0fe886-7aae-4dec-b861-8a755cf4564b service nova] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d82bfeeb-eded-4181-a988-532d8ceb698e req-0a0fe886-7aae-4dec-b861-8a755cf4564b service nova] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-d82bfeeb-eded-4181-a988-532d8ceb698e req-0a0fe886-7aae-4dec-b861-8a755cf4564b service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] No waiting events found dispatching network-vif-unplugged-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-d82bfeeb-eded-4181-a988-532d8ceb698e req-0a0fe886-7aae-4dec-b861-8a755cf4564b service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received event network-vif-unplugged-f8c478bb-de4d-494b-bfff-497255329d99 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:24:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Instance destroyed successfully.
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.objects.instance [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lazy-loading 'resources' on Instance uuid d57c5ada-750c-41af-a14c-6546374cf5d2 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556252477',display_name='tempest-VolumesAdminNegativeTest-server-1556252477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556252477',id=5,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7i/fp4Rin1cvWFPaUBVoXeuql5tIOQ/H0hw3h/ywJI5/5F9P05zCfXQLk+s/fcVdzlfngkADRf60/3wwOgqv//FYKD+8WoHl8x2HqCsAUibRod53UWk+G1SkutultlBw==',key_name='tempest-keypair-1621497382',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89956906ad1943408b1783771ee6aa32',ramdisk_id='',reservation_id='r-0xvqp0xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1994864820',owner_user_name='tempest-VolumesAdminNegativeTest-1994864820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2f78c518af14d6e84894f850811426b',uuid=d57c5ada-750c-41af-a14c-6546374cf5d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converting VIF {"id": "f8c478bb-de4d-494b-bfff-497255329d99", "address": "fa:16:3e:eb:7f:d2", "network": {"id": "710f78a2-c89f-4131-b3d4-c43cca3c5638", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1615130589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89956906ad1943408b1783771ee6aa32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c478bb-de", "ovs_interfaceid": "f8c478bb-de4d-494b-bfff-497255329d99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:7f:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8c478bb-de4d-494b-bfff-497255329d99,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c478bb-de') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_vif [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:7f:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8c478bb-de4d-494b-bfff-497255329d99,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c478bb-de') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8c478bb-de, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e294f850-fa63-4b80-b0c7-78e09ce5fd54) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_vif [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:7f:d2,bridge_name='br-int',has_traffic_filtering=True,id=f8c478bb-de4d-494b-bfff-497255329d99,network=Network(710f78a2-c89f-4131-b3d4-c43cca3c5638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c478bb-de')
Nov 10 19:24:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Deleting instance files /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2_del
Nov 10 19:24:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Deletion of /opt/stack/data/nova/instances/d57c5ada-750c-41af-a14c-6546374cf5d2_del complete
Nov 10 19:24:23 user nova-compute[75026]: INFO nova.compute.manager [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.552s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== connect_volume: return (2843ms) {'type': 'block', 'scsi_wwn': '23336366234393338', 'path': '/dev/sdg'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336366234393338', 'path': '/dev/sdg'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.518s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:23 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d5:d5,bridge_name='br-int',has_traffic_filtering=True,id=16e124c7-2ea9-4337-9d56-62d8bea0431a,network=Network(92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e124c7-2e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1b:4b,bridge_name='br-int',has_traffic_filtering=True,id=c07ef6df-4bdd-462f-8830-62315eff1120,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc07ef6df-4b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7b:df,bridge_name='br-int',has_traffic_filtering=True,id=4be4ceac-647c-47f9-b45d-f6328bd93528,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4be4ceac-64') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=69944cbd-fa51-494a-ad15-fd84fa1d2cc1,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69944cbd-fa') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:72,bridge_name='br-int',has_traffic_filtering=True,id=00869544-9765-46a7-8c86-382d13a0437b,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00869544-97') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=f4ea19cf-911c-4337-8a7c-e4bfea3417f5,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ea19cf-91') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:27,bridge_name='br-int',has_traffic_filtering=True,id=7f71ce16-64dc-41a0-bf60-e0afb8b6efe9,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f71ce16-64') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lazy-loading 'pci_devices' on Instance uuid 81632714-289b-469d-a950-55177e8da002 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db4b9f3-1e46-4dc6-ba25-2692c8843306]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:24:23 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:24:23 user nova-compute[75026]:   <uuid>81632714-289b-469d-a950-55177e8da002</uuid>
Nov 10 19:24:23 user nova-compute[75026]:   <name>instance-0000000f</name>
Nov 10 19:24:23 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:24:23 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:24:23 user nova-compute[75026]:   <metadata>
Nov 10 19:24:23 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:24:23 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:24:23 user nova-compute[75026]:       <nova:name>tempest-device-tagging-server-1127535927</nova:name>
Nov 10 19:24:23 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:24:16</nova:creationTime>
Nov 10 19:24:23 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:24:23 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:24:23 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:24:23 user nova-compute[75026]:       <nova:owner>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:user uuid="87425e99fab14d518648ac5d5ffd1477">tempest-TaggedBootDevicesTest_v242-1121871639-project-member</nova:user>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:project uuid="c7b56289216442ea891dd09bd4fb4c2f">tempest-TaggedBootDevicesTest_v242-1121871639</nova:project>
Nov 10 19:24:23 user nova-compute[75026]:       </nova:owner>
Nov 10 19:24:23 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:24:23 user nova-compute[75026]:       <nova:ports>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:port uuid="16e124c7-2ea9-4337-9d56-62d8bea0431a">
Nov 10 19:24:23 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 19:24:23 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:port uuid="c07ef6df-4bdd-462f-8830-62315eff1120">
Nov 10 19:24:23 user nova-compute[75026]:           <nova:ip type="fixed" address="10.1.1.35" ipVersion="4"/>
Nov 10 19:24:23 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:port uuid="4be4ceac-647c-47f9-b45d-f6328bd93528">
Nov 10 19:24:23 user nova-compute[75026]:           <nova:ip type="fixed" address="10.1.1.118" ipVersion="4"/>
Nov 10 19:24:23 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:port uuid="69944cbd-fa51-494a-ad15-fd84fa1d2cc1">
Nov 10 19:24:23 user nova-compute[75026]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Nov 10 19:24:23 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:port uuid="00869544-9765-46a7-8c86-382d13a0437b">
Nov 10 19:24:23 user nova-compute[75026]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Nov 10 19:24:23 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:port uuid="f4ea19cf-911c-4337-8a7c-e4bfea3417f5">
Nov 10 19:24:23 user nova-compute[75026]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 19:24:23 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:23 user nova-compute[75026]:         <nova:port uuid="7f71ce16-64dc-41a0-bf60-e0afb8b6efe9">
Nov 10 19:24:23 user nova-compute[75026]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 19:24:23 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:23 user nova-compute[75026]:       </nova:ports>
Nov 10 19:24:23 user nova-compute[75026]:     </nova:instance>
Nov 10 19:24:23 user nova-compute[75026]:   </metadata>
Nov 10 19:24:23 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:24:23 user nova-compute[75026]:     <system>
Nov 10 19:24:23 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:24:23 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:24:23 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:24:23 user nova-compute[75026]:       <entry name="serial">81632714-289b-469d-a950-55177e8da002</entry>
Nov 10 19:24:23 user nova-compute[75026]:       <entry name="uuid">81632714-289b-469d-a950-55177e8da002</entry>
Nov 10 19:24:23 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:24:23 user nova-compute[75026]:     </system>
Nov 10 19:24:23 user nova-compute[75026]:   </sysinfo>
Nov 10 19:24:23 user nova-compute[75026]:   <os>
Nov 10 19:24:23 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:24:23 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:24:23 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:24:23 user nova-compute[75026]:   </os>
Nov 10 19:24:23 user nova-compute[75026]:   <features>
Nov 10 19:24:23 user nova-compute[75026]:     <acpi/>
Nov 10 19:24:23 user nova-compute[75026]:     <apic/>
Nov 10 19:24:23 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:24:23 user nova-compute[75026]:   </features>
Nov 10 19:24:23 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:24:23 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:24:23 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:24:23 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:24:23 user nova-compute[75026]:   </clock>
Nov 10 19:24:23 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:24:23 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:24:23 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:24:23 user nova-compute[75026]:   </cpu>
Nov 10 19:24:23 user nova-compute[75026]:   <devices>
Nov 10 19:24:23 user nova-compute[75026]:     <disk type="file" device="cdrom">
Nov 10 19:24:23 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 19:24:23 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/81632714-289b-469d-a950-55177e8da002/disk.config"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="hda" bus="ide"/>
Nov 10 19:24:23 user nova-compute[75026]:     </disk>
Nov 10 19:24:23 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:24:23 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:24:23 user nova-compute[75026]:       <source dev="/dev/sdb"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <serial>3d7334ee-4cf5-4a1f-9bf1-774487ea757f</serial>
Nov 10 19:24:23 user nova-compute[75026]:     </disk>
Nov 10 19:24:23 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:24:23 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:24:23 user nova-compute[75026]:       <source dev="/dev/sde"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <serial>94378a27-6898-4d77-9e0d-fa136aad1fe2</serial>
Nov 10 19:24:23 user nova-compute[75026]:     </disk>
Nov 10 19:24:23 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:24:23 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:24:23 user nova-compute[75026]:       <source dev="/dev/sdg"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="vdc" bus="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <serial>8cd886d4-c3da-4715-bf66-2cc2e13ad42d</serial>
Nov 10 19:24:23 user nova-compute[75026]:     </disk>
Nov 10 19:24:23 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:23 user nova-compute[75026]:       <mac address="fa:16:3e:db:d5:d5"/>
Nov 10 19:24:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="tap16e124c7-2e"/>
Nov 10 19:24:23 user nova-compute[75026]:     </interface>
Nov 10 19:24:23 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:23 user nova-compute[75026]:       <mac address="fa:16:3e:d4:1b:4b"/>
Nov 10 19:24:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="tapc07ef6df-4b"/>
Nov 10 19:24:23 user nova-compute[75026]:     </interface>
Nov 10 19:24:23 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:23 user nova-compute[75026]:       <mac address="fa:16:3e:57:7b:df"/>
Nov 10 19:24:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="tap4be4ceac-64"/>
Nov 10 19:24:23 user nova-compute[75026]:     </interface>
Nov 10 19:24:23 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:23 user nova-compute[75026]:       <mac address="fa:16:3e:be:21:3b"/>
Nov 10 19:24:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="tap69944cbd-fa"/>
Nov 10 19:24:23 user nova-compute[75026]:     </interface>
Nov 10 19:24:23 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:23 user nova-compute[75026]:       <mac address="fa:16:3e:0c:06:72"/>
Nov 10 19:24:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="tap00869544-97"/>
Nov 10 19:24:23 user nova-compute[75026]:     </interface>
Nov 10 19:24:23 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:23 user nova-compute[75026]:       <mac address="fa:16:3e:94:72:2a"/>
Nov 10 19:24:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="tapf4ea19cf-91"/>
Nov 10 19:24:23 user nova-compute[75026]:     </interface>
Nov 10 19:24:23 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:23 user nova-compute[75026]:       <mac address="fa:16:3e:77:3e:27"/>
Nov 10 19:24:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:23 user nova-compute[75026]:       <target dev="tap7f71ce16-64"/>
Nov 10 19:24:23 user nova-compute[75026]:     </interface>
Nov 10 19:24:23 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:24:23 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/81632714-289b-469d-a950-55177e8da002/console.log" append="off"/>
Nov 10 19:24:23 user nova-compute[75026]:     </serial>
Nov 10 19:24:23 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:24:23 user nova-compute[75026]:     <video>
Nov 10 19:24:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:23 user nova-compute[75026]:     </video>
Nov 10 19:24:23 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:24:23 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:24:23 user nova-compute[75026]:     </rng>
Nov 10 19:24:23 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:24:23 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:24:23 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:24:23 user nova-compute[75026]:     </memballoon>
Nov 10 19:24:23 user nova-compute[75026]:   </devices>
Nov 10 19:24:23 user nova-compute[75026]: </domain>
Nov 10 19:24:23 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d5:d5,bridge_name='br-int',has_traffic_filtering=True,id=16e124c7-2ea9-4337-9d56-62d8bea0431a,network=Network(92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e124c7-2e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d5:d5,bridge_name='br-int',has_traffic_filtering=True,id=16e124c7-2ea9-4337-9d56-62d8bea0431a,network=Network(92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e124c7-2e') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc214993-ba70-4a10-8e4f-ec9a0c8a5eab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765] added
Nov 10 19:24:23 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dd51696-6b7d-54e8-b359-9e817a0abc32', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16e124c7-2e, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16e124c7-2e, col_values=(('qos', UUID('b267b719-54d1-48c6-beea-7f67dd516f9a')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16e124c7-2e, col_values=(('external_ids', {'iface-id': '16e124c7-2ea9-4337-9d56-62d8bea0431a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:d5:d5', 'vm-uuid': '81632714-289b-469d-a950-55177e8da002'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d73555-ac04-4816-9e71-b70f9c7b0408]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d5:d5,bridge_name='br-int',has_traffic_filtering=True,id=16e124c7-2ea9-4337-9d56-62d8bea0431a,network=Network(92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e124c7-2e')
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1b:4b,bridge_name='br-int',has_traffic_filtering=True,id=c07ef6df-4bdd-462f-8830-62315eff1120,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc07ef6df-4b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1b:4b,bridge_name='br-int',has_traffic_filtering=True,id=c07ef6df-4bdd-462f-8830-62315eff1120,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc07ef6df-4b') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f7bc882-8c86-565b-8f31-e3e3f89110ed', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8cbce4-c660-4508-86db-2660d1f90c85]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc07ef6df-4b, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc07ef6df-4b, col_values=(('qos', UUID('a50e68ba-9022-4853-ae8e-7d9ca8232df7')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc07ef6df-4b, col_values=(('external_ids', {'iface-id': 'c07ef6df-4bdd-462f-8830-62315eff1120', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:1b:4b', 'vm-uuid': '81632714-289b-469d-a950-55177e8da002'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSCbAYze {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSCbAYze" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feea069-9a40-455a-922e-77244399291e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1b:4b,bridge_name='br-int',has_traffic_filtering=True,id=c07ef6df-4bdd-462f-8830-62315eff1120,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc07ef6df-4b')
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7b:df,bridge_name='br-int',has_traffic_filtering=True,id=4be4ceac-647c-47f9-b45d-f6328bd93528,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4be4ceac-64') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7b:df,bridge_name='br-int',has_traffic_filtering=True,id=4be4ceac-647c-47f9-b45d-f6328bd93528,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4be4ceac-64') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSCbAYze'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '286fabce-6291-516e-9a59-f1aa56787853', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6accc341-073d-4ddf-b7d9-ed8df4c3b620]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4be4ceac-64, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4be4ceac-64, col_values=(('qos', UUID('aa4c6284-05d5-403a-a1bc-1c68851afcc7')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4be4ceac-64, col_values=(('external_ids', {'iface-id': '4be4ceac-647c-47f9-b45d-f6328bd93528', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:7b:df', 'vm-uuid': '81632714-289b-469d-a950-55177e8da002'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7b:df,bridge_name='br-int',has_traffic_filtering=True,id=4be4ceac-647c-47f9-b45d-f6328bd93528,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4be4ceac-64')
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=69944cbd-fa51-494a-ad15-fd84fa1d2cc1,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69944cbd-fa') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=69944cbd-fa51-494a-ad15-fd84fa1d2cc1,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69944cbd-fa') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d61b726-e43a-5d5f-af3f-d5cbb764f43c', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[064cfe4a-40b8-4f57-b4cc-1b906b60653f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:24:23 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:24:23 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69944cbd-fa, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69944cbd-fa, col_values=(('qos', UUID('9bbcd4c8-56e5-43ed-a8c2-c02e9f433a95')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69944cbd-fa, col_values=(('external_ids', {'iface-id': '69944cbd-fa51-494a-ad15-fd84fa1d2cc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:21:3b', 'vm-uuid': '81632714-289b-469d-a950-55177e8da002'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=69944cbd-fa51-494a-ad15-fd84fa1d2cc1,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69944cbd-fa')
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:72,bridge_name='br-int',has_traffic_filtering=True,id=00869544-9765-46a7-8c86-382d13a0437b,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00869544-97') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:72,bridge_name='br-int',has_traffic_filtering=True,id=00869544-9765-46a7-8c86-382d13a0437b,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00869544-97') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e6113bb-8f76-5d56-b033-a9be1dc7984f', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b38331-69c9-449b-8d10-e3b3e01eaef6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765, portal: 172.16.0.220,3260]
Nov 10 19:24:23 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765, portal: 172.16.0.220,3260] successful.
Nov 10 19:24:23 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3765a42f-a18b-4d61-8987-76f33603bb8e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00869544-97, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00869544-97, col_values=(('qos', UUID('b2ce8910-9cce-4145-a69f-cead392b155d')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00869544-97, col_values=(('external_ids', {'iface-id': '00869544-9765-46a7-8c86-382d13a0437b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:06:72', 'vm-uuid': '81632714-289b-469d-a950-55177e8da002'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf9395-a987-4008-9ec5-e971f0c93380]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:24:23 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:24:23 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c9d523-7866-4eb3-bcad-09482341755c]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSCbAYze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:72,bridge_name='br-int',has_traffic_filtering=True,id=00869544-9765-46a7-8c86-382d13a0437b,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00869544-97')
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=f4ea19cf-911c-4337-8a7c-e4bfea3417f5,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ea19cf-91') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=f4ea19cf-911c-4337-8a7c-e4bfea3417f5,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ea19cf-91') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bffc2b40-3acd-5e63-bff4-f563a89271f1', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4ea19cf-91, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4ea19cf-91, col_values=(('qos', UUID('8cd1f01c-0fdc-4ad8-9731-ca3928b1a3d5')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4ea19cf-91, col_values=(('external_ids', {'iface-id': 'f4ea19cf-911c-4337-8a7c-e4bfea3417f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:72:2a', 'vm-uuid': '81632714-289b-469d-a950-55177e8da002'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=f4ea19cf-911c-4337-8a7c-e4bfea3417f5,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ea19cf-91')
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:27,bridge_name='br-int',has_traffic_filtering=True,id=7f71ce16-64dc-41a0-bf60-e0afb8b6efe9,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f71ce16-64') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:27,bridge_name='br-int',has_traffic_filtering=True,id=7f71ce16-64dc-41a0-bf60-e0afb8b6efe9,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f71ce16-64') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c682ca2-176c-5211-a1bc-05deb078e7a9', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f71ce16-64, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f71ce16-64, col_values=(('qos', UUID('6a9bc59b-7ff8-4dec-9802-6610da3f4cd0')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f71ce16-64, col_values=(('external_ids', {'iface-id': '7f71ce16-64dc-41a0-bf60-e0afb8b6efe9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:3e:27', 'vm-uuid': '81632714-289b-469d-a950-55177e8da002'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:23 user nova-compute[75026]: INFO os_vif [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:27,bridge_name='br-int',has_traffic_filtering=True,id=7f71ce16-64dc-41a0-bf60-e0afb8b6efe9,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f71ce16-64')
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] No BDM found with device name hda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] No VIF found with MAC fa:16:3e:db:d5:d5, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] No VIF found with MAC fa:16:3e:0c:06:72, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:24:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Using config drive
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:24 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Took 1.00 seconds to deallocate network for instance.
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Creating config drive at /opt/stack/data/nova/instances/81632714-289b-469d-a950-55177e8da002/disk.config
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81632714-289b-469d-a950-55177e8da002/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4karfpsn {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81632714-289b-469d-a950-55177e8da002/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4karfpsn" returned: 0 in 0.056s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-3154fc02-cc26-42f8-8d16-657c4bd70198 req-903b4442-a80e-4893-a147-141870a5a12a service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received event network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3154fc02-cc26-42f8-8d16-657c4bd70198 req-903b4442-a80e-4893-a147-141870a5a12a service nova] Acquiring lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3154fc02-cc26-42f8-8d16-657c4bd70198 req-903b4442-a80e-4893-a147-141870a5a12a service nova] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3154fc02-cc26-42f8-8d16-657c4bd70198 req-903b4442-a80e-4893-a147-141870a5a12a service nova] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-3154fc02-cc26-42f8-8d16-657c4bd70198 req-903b4442-a80e-4893-a147-141870a5a12a service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] No waiting events found dispatching network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:24 user nova-compute[75026]: WARNING nova.compute.manager [req-3154fc02-cc26-42f8-8d16-657c4bd70198 req-903b4442-a80e-4893-a147-141870a5a12a service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received unexpected event network-vif-plugged-f8c478bb-de4d-494b-bfff-497255329d99 for instance with vm_state deleted and task_state None.
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-3154fc02-cc26-42f8-8d16-657c4bd70198 req-903b4442-a80e-4893-a147-141870a5a12a service nova] [instance: d57c5ada-750c-41af-a14c-6546374cf5d2] Received event network-vif-deleted-f8c478bb-de4d-494b-bfff-497255329d99 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== connect_volume: return (2970ms) {'type': 'block', 'scsi_wwn': '23733613039323664', 'path': '/dev/sdh'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733613039323664', 'path': '/dev/sdh'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2e:69,bridge_name='br-int',has_traffic_filtering=True,id=0ca08991-e4a7-472e-9b3b-fa8859848b3d,network=Network(b0e32b3b-3363-4242-8bcf-d8ad6ff14b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca08991-e4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:91:55,bridge_name='br-int',has_traffic_filtering=True,id=532b429b-bd11-489f-a885-1c50ab94ca0e,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap532b429b-bd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:86:a5,bridge_name='br-int',has_traffic_filtering=True,id=21ba1689-92a0-4756-b441-d5c39fd32bf9,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21ba1689-92') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:f6,bridge_name='br-int',has_traffic_filtering=True,id=8f6497a9-e4cf-46d2-a255-c55eabcc9531,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f6497a9-e4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:28:e7,bridge_name='br-int',has_traffic_filtering=True,id=9f98a01d-0d0f-4457-a1ec-06649ad24312,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f98a01d-0d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7c:90,bridge_name='br-int',has_traffic_filtering=True,id=8155e82e-493d-4bcc-918f-571aac53ecb1,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8155e82e-49') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:31,bridge_name='br-int',has_traffic_filtering=True,id=37f75097-1500-400d-9ef4-68318d093eec,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f75097-15') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.objects.instance [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lazy-loading 'pci_devices' on Instance uuid c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:24:24 user nova-compute[75026]:   <uuid>c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a</uuid>
Nov 10 19:24:24 user nova-compute[75026]:   <name>instance-0000000e</name>
Nov 10 19:24:24 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:24:24 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:24:24 user nova-compute[75026]:   <metadata>
Nov 10 19:24:24 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:24:24 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:24:24 user nova-compute[75026]:       <nova:name>tempest-device-tagging-server-1719862568</nova:name>
Nov 10 19:24:24 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:24:16</nova:creationTime>
Nov 10 19:24:24 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:24:24 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:24:24 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:24:24 user nova-compute[75026]:       <nova:owner>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:user uuid="4ece2c4c22cf436083e053d9f2cf26db">tempest-TaggedBootDevicesTest-607045118-project-member</nova:user>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:project uuid="9addd4a21ed84ad9a226da278b948f73">tempest-TaggedBootDevicesTest-607045118</nova:project>
Nov 10 19:24:24 user nova-compute[75026]:       </nova:owner>
Nov 10 19:24:24 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:24:24 user nova-compute[75026]:       <nova:ports>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:port uuid="0ca08991-e4a7-472e-9b3b-fa8859848b3d">
Nov 10 19:24:24 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:24:24 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:port uuid="532b429b-bd11-489f-a885-1c50ab94ca0e">
Nov 10 19:24:24 user nova-compute[75026]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Nov 10 19:24:24 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:port uuid="21ba1689-92a0-4756-b441-d5c39fd32bf9">
Nov 10 19:24:24 user nova-compute[75026]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Nov 10 19:24:24 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:port uuid="8f6497a9-e4cf-46d2-a255-c55eabcc9531">
Nov 10 19:24:24 user nova-compute[75026]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Nov 10 19:24:24 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:port uuid="9f98a01d-0d0f-4457-a1ec-06649ad24312">
Nov 10 19:24:24 user nova-compute[75026]:           <nova:ip type="fixed" address="10.1.1.104" ipVersion="4"/>
Nov 10 19:24:24 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:port uuid="8155e82e-493d-4bcc-918f-571aac53ecb1">
Nov 10 19:24:24 user nova-compute[75026]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 19:24:24 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:24 user nova-compute[75026]:         <nova:port uuid="37f75097-1500-400d-9ef4-68318d093eec">
Nov 10 19:24:24 user nova-compute[75026]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 19:24:24 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:24 user nova-compute[75026]:       </nova:ports>
Nov 10 19:24:24 user nova-compute[75026]:     </nova:instance>
Nov 10 19:24:24 user nova-compute[75026]:   </metadata>
Nov 10 19:24:24 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:24:24 user nova-compute[75026]:     <system>
Nov 10 19:24:24 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:24:24 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:24:24 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:24:24 user nova-compute[75026]:       <entry name="serial">c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a</entry>
Nov 10 19:24:24 user nova-compute[75026]:       <entry name="uuid">c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a</entry>
Nov 10 19:24:24 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:24:24 user nova-compute[75026]:     </system>
Nov 10 19:24:24 user nova-compute[75026]:   </sysinfo>
Nov 10 19:24:24 user nova-compute[75026]:   <os>
Nov 10 19:24:24 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:24:24 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:24:24 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:24:24 user nova-compute[75026]:   </os>
Nov 10 19:24:24 user nova-compute[75026]:   <features>
Nov 10 19:24:24 user nova-compute[75026]:     <acpi/>
Nov 10 19:24:24 user nova-compute[75026]:     <apic/>
Nov 10 19:24:24 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:24:24 user nova-compute[75026]:   </features>
Nov 10 19:24:24 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:24:24 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:24:24 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:24:24 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:24:24 user nova-compute[75026]:   </clock>
Nov 10 19:24:24 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:24:24 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:24:24 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:24:24 user nova-compute[75026]:   </cpu>
Nov 10 19:24:24 user nova-compute[75026]:   <devices>
Nov 10 19:24:24 user nova-compute[75026]:     <disk type="file" device="cdrom">
Nov 10 19:24:24 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 19:24:24 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a/disk.config"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="hda" bus="ide"/>
Nov 10 19:24:24 user nova-compute[75026]:     </disk>
Nov 10 19:24:24 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:24:24 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:24:24 user nova-compute[75026]:       <source dev="/dev/sdd"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <serial>5909e5b4-3695-4425-b3dd-9c6cb52328f8</serial>
Nov 10 19:24:24 user nova-compute[75026]:     </disk>
Nov 10 19:24:24 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:24:24 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:24:24 user nova-compute[75026]:       <source dev="/dev/sdf"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <serial>a23eb6b9-10b2-4ff1-aac9-c12961105a89</serial>
Nov 10 19:24:24 user nova-compute[75026]:     </disk>
Nov 10 19:24:24 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:24:24 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:24:24 user nova-compute[75026]:       <source dev="/dev/sdh"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="vdc" bus="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <serial>1b3f4033-c186-4a8c-ae63-2b2c914dc765</serial>
Nov 10 19:24:24 user nova-compute[75026]:     </disk>
Nov 10 19:24:24 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:24 user nova-compute[75026]:       <mac address="fa:16:3e:2b:2e:69"/>
Nov 10 19:24:24 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="tap0ca08991-e4"/>
Nov 10 19:24:24 user nova-compute[75026]:     </interface>
Nov 10 19:24:24 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:24 user nova-compute[75026]:       <mac address="fa:16:3e:a9:91:55"/>
Nov 10 19:24:24 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="tap532b429b-bd"/>
Nov 10 19:24:24 user nova-compute[75026]:     </interface>
Nov 10 19:24:24 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:24 user nova-compute[75026]:       <mac address="fa:16:3e:e8:86:a5"/>
Nov 10 19:24:24 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="tap21ba1689-92"/>
Nov 10 19:24:24 user nova-compute[75026]:     </interface>
Nov 10 19:24:24 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:24 user nova-compute[75026]:       <mac address="fa:16:3e:72:48:f6"/>
Nov 10 19:24:24 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="tap8f6497a9-e4"/>
Nov 10 19:24:24 user nova-compute[75026]:     </interface>
Nov 10 19:24:24 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:24 user nova-compute[75026]:       <mac address="fa:16:3e:c0:28:e7"/>
Nov 10 19:24:24 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="tap9f98a01d-0d"/>
Nov 10 19:24:24 user nova-compute[75026]:     </interface>
Nov 10 19:24:24 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:24 user nova-compute[75026]:       <mac address="fa:16:3e:e7:7c:90"/>
Nov 10 19:24:24 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="tap8155e82e-49"/>
Nov 10 19:24:24 user nova-compute[75026]:     </interface>
Nov 10 19:24:24 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:24 user nova-compute[75026]:       <mac address="fa:16:3e:bf:29:31"/>
Nov 10 19:24:24 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:24 user nova-compute[75026]:       <target dev="tap37f75097-15"/>
Nov 10 19:24:24 user nova-compute[75026]:     </interface>
Nov 10 19:24:24 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:24:24 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a/console.log" append="off"/>
Nov 10 19:24:24 user nova-compute[75026]:     </serial>
Nov 10 19:24:24 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:24:24 user nova-compute[75026]:     <video>
Nov 10 19:24:24 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:24 user nova-compute[75026]:     </video>
Nov 10 19:24:24 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:24:24 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:24:24 user nova-compute[75026]:     </rng>
Nov 10 19:24:24 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:24:24 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:24:24 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:24:24 user nova-compute[75026]:     </memballoon>
Nov 10 19:24:24 user nova-compute[75026]:   </devices>
Nov 10 19:24:24 user nova-compute[75026]: </domain>
Nov 10 19:24:24 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2e:69,bridge_name='br-int',has_traffic_filtering=True,id=0ca08991-e4a7-472e-9b3b-fa8859848b3d,network=Network(b0e32b3b-3363-4242-8bcf-d8ad6ff14b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca08991-e4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2e:69,bridge_name='br-int',has_traffic_filtering=True,id=0ca08991-e4a7-472e-9b3b-fa8859848b3d,network=Network(b0e32b3b-3363-4242-8bcf-d8ad6ff14b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca08991-e4') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '433f4757-b0e0-5d1b-a54c-5d966f4c1769', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:24 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Deleted allocations for instance d57c5ada-750c-41af-a14c-6546374cf5d2
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca08991-e4, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ca08991-e4, col_values=(('qos', UUID('5f95551e-5a0c-46ed-ae48-494548fabb21')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ca08991-e4, col_values=(('external_ids', {'iface-id': '0ca08991-e4a7-472e-9b3b-fa8859848b3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:2e:69', 'vm-uuid': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64db330f-d84c-40b4-bca4-19127fd7febc tempest-VolumesAdminNegativeTest-1994864820 tempest-VolumesAdminNegativeTest-1994864820-project-member] Lock "d57c5ada-750c-41af-a14c-6546374cf5d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.839s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: INFO os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2e:69,bridge_name='br-int',has_traffic_filtering=True,id=0ca08991-e4a7-472e-9b3b-fa8859848b3d,network=Network(b0e32b3b-3363-4242-8bcf-d8ad6ff14b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca08991-e4')
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:91:55,bridge_name='br-int',has_traffic_filtering=True,id=532b429b-bd11-489f-a885-1c50ab94ca0e,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap532b429b-bd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:91:55,bridge_name='br-int',has_traffic_filtering=True,id=532b429b-bd11-489f-a885-1c50ab94ca0e,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap532b429b-bd') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee12b993-2fac-57e2-a563-f83aff8c7ed5', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap532b429b-bd, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap532b429b-bd, col_values=(('qos', UUID('37ad2ea7-df41-4529-a272-702723dcf7f7')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap532b429b-bd, col_values=(('external_ids', {'iface-id': '532b429b-bd11-489f-a885-1c50ab94ca0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:91:55', 'vm-uuid': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: INFO os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:91:55,bridge_name='br-int',has_traffic_filtering=True,id=532b429b-bd11-489f-a885-1c50ab94ca0e,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap532b429b-bd')
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:86:a5,bridge_name='br-int',has_traffic_filtering=True,id=21ba1689-92a0-4756-b441-d5c39fd32bf9,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21ba1689-92') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:86:a5,bridge_name='br-int',has_traffic_filtering=True,id=21ba1689-92a0-4756-b441-d5c39fd32bf9,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21ba1689-92') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39147b9c-7368-5c20-b943-615ff3a8cdc9', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21ba1689-92, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21ba1689-92, col_values=(('qos', UUID('45017dc5-da87-42ba-8bec-49818756e05d')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21ba1689-92, col_values=(('external_ids', {'iface-id': '21ba1689-92a0-4756-b441-d5c39fd32bf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:86:a5', 'vm-uuid': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: INFO os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:86:a5,bridge_name='br-int',has_traffic_filtering=True,id=21ba1689-92a0-4756-b441-d5c39fd32bf9,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21ba1689-92')
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:f6,bridge_name='br-int',has_traffic_filtering=True,id=8f6497a9-e4cf-46d2-a255-c55eabcc9531,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f6497a9-e4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:f6,bridge_name='br-int',has_traffic_filtering=True,id=8f6497a9-e4cf-46d2-a255-c55eabcc9531,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f6497a9-e4') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29327ca2-115d-5f9c-ac23-bdc5702588bd', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f6497a9-e4, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f6497a9-e4, col_values=(('qos', UUID('26dc26a8-54e1-4389-b79d-b2e21f24fc20')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f6497a9-e4, col_values=(('external_ids', {'iface-id': '8f6497a9-e4cf-46d2-a255-c55eabcc9531', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:48:f6', 'vm-uuid': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: INFO os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:f6,bridge_name='br-int',has_traffic_filtering=True,id=8f6497a9-e4cf-46d2-a255-c55eabcc9531,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f6497a9-e4')
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:28:e7,bridge_name='br-int',has_traffic_filtering=True,id=9f98a01d-0d0f-4457-a1ec-06649ad24312,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f98a01d-0d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:28:e7,bridge_name='br-int',has_traffic_filtering=True,id=9f98a01d-0d0f-4457-a1ec-06649ad24312,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f98a01d-0d') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ec80dfd-55f2-57aa-95b8-d82f79078f34', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f98a01d-0d, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f98a01d-0d, col_values=(('qos', UUID('631ddb31-e674-48e8-a10d-0771401b1ba3')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f98a01d-0d, col_values=(('external_ids', {'iface-id': '9f98a01d-0d0f-4457-a1ec-06649ad24312', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:28:e7', 'vm-uuid': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: INFO os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:28:e7,bridge_name='br-int',has_traffic_filtering=True,id=9f98a01d-0d0f-4457-a1ec-06649ad24312,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f98a01d-0d')
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7c:90,bridge_name='br-int',has_traffic_filtering=True,id=8155e82e-493d-4bcc-918f-571aac53ecb1,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8155e82e-49') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7c:90,bridge_name='br-int',has_traffic_filtering=True,id=8155e82e-493d-4bcc-918f-571aac53ecb1,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8155e82e-49') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48dc1e1c-3ed3-59ff-8bb9-d1ff3e31fbed', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8155e82e-49, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8155e82e-49, col_values=(('qos', UUID('18a9f194-f73d-4ec3-88b9-5436b018be32')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8155e82e-49, col_values=(('external_ids', {'iface-id': '8155e82e-493d-4bcc-918f-571aac53ecb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:7c:90', 'vm-uuid': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-b265fa8d-2172-400d-aec4-28f9263820c8 req-da1488e5-9319-4946-add0-a4edfbe57080 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b265fa8d-2172-400d-aec4-28f9263820c8 req-da1488e5-9319-4946-add0-a4edfbe57080 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b265fa8d-2172-400d-aec4-28f9263820c8 req-da1488e5-9319-4946-add0-a4edfbe57080 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b265fa8d-2172-400d-aec4-28f9263820c8 req-da1488e5-9319-4946-add0-a4edfbe57080 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-b265fa8d-2172-400d-aec4-28f9263820c8 req-da1488e5-9319-4946-add0-a4edfbe57080 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:26 user nova-compute[75026]: WARNING nova.compute.manager [req-b265fa8d-2172-400d-aec4-28f9263820c8 req-da1488e5-9319-4946-add0-a4edfbe57080 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a for instance with vm_state building and task_state spawning.
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: INFO os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7c:90,bridge_name='br-int',has_traffic_filtering=True,id=8155e82e-493d-4bcc-918f-571aac53ecb1,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8155e82e-49')
Nov 10 19:24:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:31,bridge_name='br-int',has_traffic_filtering=True,id=37f75097-1500-400d-9ef4-68318d093eec,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f75097-15') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:31,bridge_name='br-int',has_traffic_filtering=True,id=37f75097-1500-400d-9ef4-68318d093eec,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f75097-15') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89bcb451-bbfa-58bb-bf1f-5f44b22a33ab', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37f75097-15, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37f75097-15, col_values=(('qos', UUID('96135162-7800-4b3a-8aab-b7d61a4fa164')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37f75097-15, col_values=(('external_ids', {'iface-id': '37f75097-1500-400d-9ef4-68318d093eec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:29:31', 'vm-uuid': 'c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: INFO os_vif [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:31,bridge_name='br-int',has_traffic_filtering=True,id=37f75097-1500-400d-9ef4-68318d093eec,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f75097-15')
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] No BDM found with device name hda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] No VIF found with MAC fa:16:3e:2b:2e:69, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] No VIF found with MAC fa:16:3e:c0:28:e7, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:24:27 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Using config drive
Nov 10 19:24:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-4f1c21f6-e065-45d5-85ae-5344a45bb066 req-811f0b1e-b1e1-4e99-a34d-ae87ad46d491 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4f1c21f6-e065-45d5-85ae-5344a45bb066 req-811f0b1e-b1e1-4e99-a34d-ae87ad46d491 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4f1c21f6-e065-45d5-85ae-5344a45bb066 req-811f0b1e-b1e1-4e99-a34d-ae87ad46d491 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4f1c21f6-e065-45d5-85ae-5344a45bb066 req-811f0b1e-b1e1-4e99-a34d-ae87ad46d491 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-4f1c21f6-e065-45d5-85ae-5344a45bb066 req-811f0b1e-b1e1-4e99-a34d-ae87ad46d491 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:27 user nova-compute[75026]: WARNING nova.compute.manager [req-4f1c21f6-e065-45d5-85ae-5344a45bb066 req-811f0b1e-b1e1-4e99-a34d-ae87ad46d491 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 for instance with vm_state building and task_state spawning.
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Creating config drive at /opt/stack/data/nova/instances/c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a/disk.config
Nov 10 19:24:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxei5xz8z {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxei5xz8z" returned: 0 in 0.070s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:28 user nova-compute[75026]: WARNING nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a for instance with vm_state building and task_state spawning.
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:28 user nova-compute[75026]: WARNING nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 for instance with vm_state building and task_state spawning.
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:28 user nova-compute[75026]: WARNING nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 for instance with vm_state building and task_state spawning.
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:28 user nova-compute[75026]: WARNING nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 for instance with vm_state building and task_state spawning.
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:28 user nova-compute[75026]: WARNING nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 for instance with vm_state building and task_state spawning.
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:28 user nova-compute[75026]: WARNING nova.compute.manager [req-5f0a332b-1f2e-4951-a561-f85a5660b2d3 req-83c9d452-43d1-4355-95c8-2e275b9deb42 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 for instance with vm_state building and task_state spawning.
Nov 10 19:24:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:29 user nova-compute[75026]: WARNING nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 for instance with vm_state building and task_state spawning.
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:29 user nova-compute[75026]: WARNING nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b for instance with vm_state building and task_state spawning.
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:29 user nova-compute[75026]: WARNING nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b for instance with vm_state building and task_state spawning.
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:29 user nova-compute[75026]: WARNING nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 for instance with vm_state building and task_state spawning.
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:29 user nova-compute[75026]: WARNING nova.compute.manager [req-36d6a112-de90-4011-a495-05b383f367ca req-3b1f0de0-163c-4afc-ac84-6508b40aabc9 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 for instance with vm_state building and task_state spawning.
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-94f3511d-9089-431a-bc14-61515ee8e813 req-52e1ed98-8948-4379-9cd1-ff134c7aee5b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-94f3511d-9089-431a-bc14-61515ee8e813 req-52e1ed98-8948-4379-9cd1-ff134c7aee5b service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-94f3511d-9089-431a-bc14-61515ee8e813 req-52e1ed98-8948-4379-9cd1-ff134c7aee5b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-94f3511d-9089-431a-bc14-61515ee8e813 req-52e1ed98-8948-4379-9cd1-ff134c7aee5b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-94f3511d-9089-431a-bc14-61515ee8e813 req-52e1ed98-8948-4379-9cd1-ff134c7aee5b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:30 user nova-compute[75026]: WARNING nova.compute.manager [req-94f3511d-9089-431a-bc14-61515ee8e813 req-52e1ed98-8948-4379-9cd1-ff134c7aee5b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d for instance with vm_state building and task_state spawning.
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-bdd023d4-ed74-4dc4-815a-a561d0a3dbaa req-fa6d549c-6f0c-4ec8-82f5-1989396e84de service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bdd023d4-ed74-4dc4-815a-a561d0a3dbaa req-fa6d549c-6f0c-4ec8-82f5-1989396e84de service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bdd023d4-ed74-4dc4-815a-a561d0a3dbaa req-fa6d549c-6f0c-4ec8-82f5-1989396e84de service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bdd023d4-ed74-4dc4-815a-a561d0a3dbaa req-fa6d549c-6f0c-4ec8-82f5-1989396e84de service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-bdd023d4-ed74-4dc4-815a-a561d0a3dbaa req-fa6d549c-6f0c-4ec8-82f5-1989396e84de service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:30 user nova-compute[75026]: WARNING nova.compute.manager [req-bdd023d4-ed74-4dc4-815a-a561d0a3dbaa req-fa6d549c-6f0c-4ec8-82f5-1989396e84de service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 for instance with vm_state building and task_state spawning.
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-8c88bac8-7e39-452f-a18b-b827d1b7e76f req-5b61eb6f-7a7b-4f6f-8114-4f8e026f271b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c88bac8-7e39-452f-a18b-b827d1b7e76f req-5b61eb6f-7a7b-4f6f-8114-4f8e026f271b service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c88bac8-7e39-452f-a18b-b827d1b7e76f req-5b61eb6f-7a7b-4f6f-8114-4f8e026f271b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c88bac8-7e39-452f-a18b-b827d1b7e76f req-5b61eb6f-7a7b-4f6f-8114-4f8e026f271b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-8c88bac8-7e39-452f-a18b-b827d1b7e76f req-5b61eb6f-7a7b-4f6f-8114-4f8e026f271b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-8c88bac8-7e39-452f-a18b-b827d1b7e76f req-5b61eb6f-7a7b-4f6f-8114-4f8e026f271b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-1e870b82-e0b3-4316-ac1f-808f074428dc req-1d92d96c-0a84-46f3-acd9-81782e5f765b service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:32 user nova-compute[75026]: WARNING nova.compute.manager [req-12715d29-1802-4e07-a7b8-88a235ce5b55 req-07fc65d4-d849-40d3-87a4-671984c8fab5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 for instance with vm_state building and task_state spawning.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:24:32 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 81632714-289b-469d-a950-55177e8da002] Instance spawned successfully.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:32 user nova-compute[75026]: INFO nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Took 16.66 seconds to spawn the instance on the hypervisor.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:32 user nova-compute[75026]: INFO nova.compute.manager [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Took 142.25 seconds to build instance.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d7e14c0-afd9-4087-b2f6-6a96dc7bf3f4 tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "81632714-289b-469d-a950-55177e8da002" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 142.383s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "81632714-289b-469d-a950-55177e8da002" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 114.536s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:32 user nova-compute[75026]: INFO nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 81632714-289b-469d-a950-55177e8da002] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 10 19:24:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "81632714-289b-469d-a950-55177e8da002" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-21875021-8dc5-4844-9bcc-199265a40944 req-e39dfafa-f9d4-4c29-aecc-eda2c6e4d9c5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-21875021-8dc5-4844-9bcc-199265a40944 req-e39dfafa-f9d4-4c29-aecc-eda2c6e4d9c5 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-21875021-8dc5-4844-9bcc-199265a40944 req-e39dfafa-f9d4-4c29-aecc-eda2c6e4d9c5 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-21875021-8dc5-4844-9bcc-199265a40944 req-e39dfafa-f9d4-4c29-aecc-eda2c6e4d9c5 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-21875021-8dc5-4844-9bcc-199265a40944 req-e39dfafa-f9d4-4c29-aecc-eda2c6e4d9c5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:34 user nova-compute[75026]: WARNING nova.compute.manager [req-21875021-8dc5-4844-9bcc-199265a40944 req-e39dfafa-f9d4-4c29-aecc-eda2c6e4d9c5 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 for instance with vm_state building and task_state spawning.
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-1896bd10-1177-4ab6-91ba-d844962dc826 req-0f5ef3bc-4d1c-4208-870b-61bf0c34e5d1 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1896bd10-1177-4ab6-91ba-d844962dc826 req-0f5ef3bc-4d1c-4208-870b-61bf0c34e5d1 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1896bd10-1177-4ab6-91ba-d844962dc826 req-0f5ef3bc-4d1c-4208-870b-61bf0c34e5d1 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1896bd10-1177-4ab6-91ba-d844962dc826 req-0f5ef3bc-4d1c-4208-870b-61bf0c34e5d1 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-1896bd10-1177-4ab6-91ba-d844962dc826 req-0f5ef3bc-4d1c-4208-870b-61bf0c34e5d1 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:34 user nova-compute[75026]: WARNING nova.compute.manager [req-1896bd10-1177-4ab6-91ba-d844962dc826 req-0f5ef3bc-4d1c-4208-870b-61bf0c34e5d1 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 for instance with vm_state building and task_state spawning.
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:34 user nova-compute[75026]: WARNING nova.compute.manager [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec for instance with vm_state building and task_state spawning.
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:34 user nova-compute[75026]: WARNING nova.compute.manager [req-45004828-1041-4fb8-bdc2-cfaf17aa019c req-9287d9da-347a-449e-bc9d-303db86ce220 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec for instance with vm_state building and task_state spawning.
Nov 10 19:24:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:24:34 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance spawned successfully.
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:34 user nova-compute[75026]: INFO nova.compute.manager [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Terminating instance
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:24:34 user nova-compute[75026]: INFO nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Took 18.79 seconds to spawn the instance on the hypervisor.
Nov 10 19:24:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:24:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:35 user nova-compute[75026]: INFO nova.compute.manager [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Took 215.47 seconds to build instance.
Nov 10 19:24:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6f775be5-1e2e-488a-8145-d835feeed396 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 215.621s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 116.760s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:35 user nova-compute[75026]: INFO nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 10 19:24:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Instance destroyed successfully.
Nov 10 19:24:35 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lazy-loading 'resources' on Instance uuid f86437d3-8401-4c25-8122-1dcb98c1cd19 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1462598103',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1462598103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1462598',id=12,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDYBzuRNmUvSH3jE33C/swn6QVkUov5mdoHqC3AMhHCRb8+jmpDBiq0uOcx5DsDKCKluGlNdpe7nBXyWoxEB9kLa1zPMsArCFStA34f2nOcnMGMDP13gRnce90B9dWnww==',key_name='tempest-keypair-1300822874',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e929bc4ed12347bc89619424def602a4',ramdisk_id='',reservation_id='r-07qt0n6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1864760290',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579c51e84dc948dcadf42c8b7f8fe2f7',uuid=f86437d3-8401-4c25-8122-1dcb98c1cd19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Converting VIF {"id": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "address": "fa:16:3e:56:fc:ef", "network": {"id": "963af7c1-f2a9-4cff-8187-1e0b43f80fbd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1185790800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e929bc4ed12347bc89619424def602a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6224ed-0e", "ovs_interfaceid": "6b6224ed-0ed5-4643-9ae0-ae460f8347b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:fc:ef,bridge_name='br-int',has_traffic_filtering=True,id=6b6224ed-0ed5-4643-9ae0-ae460f8347b6,network=Network(963af7c1-f2a9-4cff-8187-1e0b43f80fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6224ed-0e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG os_vif [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fc:ef,bridge_name='br-int',has_traffic_filtering=True,id=6b6224ed-0ed5-4643-9ae0-ae460f8347b6,network=Network(963af7c1-f2a9-4cff-8187-1e0b43f80fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6224ed-0e') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b6224ed-0e, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c87f0ea-2d95-4200-a6ab-c0eda2dcb1f4) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:35 user nova-compute[75026]: INFO os_vif [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fc:ef,bridge_name='br-int',has_traffic_filtering=True,id=6b6224ed-0ed5-4643-9ae0-ae460f8347b6,network=Network(963af7c1-f2a9-4cff-8187-1e0b43f80fbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6224ed-0e')
Nov 10 19:24:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Deleting instance files /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19_del
Nov 10 19:24:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Deletion of /opt/stack/data/nova/instances/f86437d3-8401-4c25-8122-1dcb98c1cd19_del complete
Nov 10 19:24:35 user nova-compute[75026]: INFO nova.compute.manager [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 10 19:24:35 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:24:35 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received event network-vif-unplugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] No waiting events found dispatching network-vif-unplugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received event network-vif-unplugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received event network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] Acquiring lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] No waiting events found dispatching network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:36 user nova-compute[75026]: WARNING nova.compute.manager [req-ca5c8ef5-ed65-48d0-8227-ea628677a33c req-38978d30-eb5b-4e0f-a77f-574623ef093e service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received unexpected event network-vif-plugged-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 for instance with vm_state active and task_state deleting.
Nov 10 19:24:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-d78d4f83-6c7a-4ccf-ae76-15a342326237 req-56f07edd-49fb-4d18-8d1c-305213f956f1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Received event network-vif-deleted-6b6224ed-0ed5-4643-9ae0-ae460f8347b6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:36 user nova-compute[75026]: INFO nova.compute.manager [req-d78d4f83-6c7a-4ccf-ae76-15a342326237 req-56f07edd-49fb-4d18-8d1c-305213f956f1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Neutron deleted interface 6b6224ed-0ed5-4643-9ae0-ae460f8347b6; detaching it from the instance and deleting it from the info cache
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.network.neutron [req-d78d4f83-6c7a-4ccf-ae76-15a342326237 req-56f07edd-49fb-4d18-8d1c-305213f956f1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:36 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Took 0.74 seconds to deallocate network for instance.
Nov 10 19:24:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-d78d4f83-6c7a-4ccf-ae76-15a342326237 req-56f07edd-49fb-4d18-8d1c-305213f956f1 service nova] [instance: f86437d3-8401-4c25-8122-1dcb98c1cd19] Detach interface failed, port_id=6b6224ed-0ed5-4643-9ae0-ae460f8347b6, reason: Instance f86437d3-8401-4c25-8122-1dcb98c1cd19 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:37 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:24:37 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:24:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:37 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Deleted allocations for instance f86437d3-8401-4c25-8122-1dcb98c1cd19
Nov 10 19:24:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d4ced405-3d65-4982-8cf6-cfb023c8ace0 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290 tempest-TestServerVolumeAttachScenarioOldVersion-1864760290-project-member] Lock "f86437d3-8401-4c25-8122-1dcb98c1cd19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:24:51 user nova-compute[75026]: INFO nova.compute.claims [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Claim successful on node user
Nov 10 19:24:51 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:24:51 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:24:51 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:24:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG nova.policy [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f95e8bc5971d4c06b6755ad1f63c6856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ae442a2faf4481a3fb87b1c7ea53bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:24:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Creating image(s)
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "/opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "/opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "/opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.210s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk 1073741824" returned: 0 in 0.080s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Successfully created port: dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.292s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:24:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Cannot resize image /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Ensure instance console log exists: /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Successfully updated port: dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquired lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e00eff6-7776-4e0f-bb21-4f546d766036 req-fd425a3a-9f58-4770-81cc-036fc65519ea service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received event network-changed-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-1e00eff6-7776-4e0f-bb21-4f546d766036 req-fd425a3a-9f58-4770-81cc-036fc65519ea service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Refreshing instance network info cache due to event network-changed-dd88a6d2-cac6-453c-bddd-074cdf43f560. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e00eff6-7776-4e0f-bb21-4f546d766036 req-fd425a3a-9f58-4770-81cc-036fc65519ea service nova] Acquiring lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:24:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updating instance_info_cache with network_info: [{"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Releasing lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Instance network_info: |[{"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e00eff6-7776-4e0f-bb21-4f546d766036 req-fd425a3a-9f58-4770-81cc-036fc65519ea service nova] Acquired lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-1e00eff6-7776-4e0f-bb21-4f546d766036 req-fd425a3a-9f58-4770-81cc-036fc65519ea service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Refreshing network info cache for port dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Start _get_guest_xml network_info=[{"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:24:54 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:54 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-586203153',display_name='tempest-VolumesSnapshotTestJSON-instance-586203153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-586203153',id=17,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz5k/6fEXDYqd27EN6La0ckHLAMY+FyOYGTb8ROihZHjsjUwyjngJCx8yXWRG8GHGjVJTXQtefA6LWkHRE9zC+9yrw4XV/12Mu3jVEfGI+2FEBRHCMcyU9HcEs4PMC93A==',key_name='tempest-keypair-525285770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ae442a2faf4481a3fb87b1c7ea53bf',ramdisk_id='',reservation_id='r-bx7m7rnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1891642589',owner_user_name='tempest-VolumesSnapshotTestJSON-1891642589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f95e8bc5971d4c06b6755ad1f63c6856',uuid=f888a7cc-f582-4e5e-8e70-4fada2e30591,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converting VIF {"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:80:f9,bridge_name='br-int',has_traffic_filtering=True,id=dd88a6d2-cac6-453c-bddd-074cdf43f560,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd88a6d2-ca') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'pci_devices' on Instance uuid f888a7cc-f582-4e5e-8e70-4fada2e30591 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:24:54 user nova-compute[75026]:   <uuid>f888a7cc-f582-4e5e-8e70-4fada2e30591</uuid>
Nov 10 19:24:54 user nova-compute[75026]:   <name>instance-00000011</name>
Nov 10 19:24:54 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:24:54 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:24:54 user nova-compute[75026]:   <metadata>
Nov 10 19:24:54 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:24:54 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:24:54 user nova-compute[75026]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-586203153</nova:name>
Nov 10 19:24:54 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:24:54</nova:creationTime>
Nov 10 19:24:54 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:24:54 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:24:54 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:24:54 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:24:54 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:24:54 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:24:54 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:24:54 user nova-compute[75026]:       <nova:owner>
Nov 10 19:24:54 user nova-compute[75026]:         <nova:user uuid="f95e8bc5971d4c06b6755ad1f63c6856">tempest-VolumesSnapshotTestJSON-1891642589-project-member</nova:user>
Nov 10 19:24:54 user nova-compute[75026]:         <nova:project uuid="50ae442a2faf4481a3fb87b1c7ea53bf">tempest-VolumesSnapshotTestJSON-1891642589</nova:project>
Nov 10 19:24:54 user nova-compute[75026]:       </nova:owner>
Nov 10 19:24:54 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:24:54 user nova-compute[75026]:       <nova:ports>
Nov 10 19:24:54 user nova-compute[75026]:         <nova:port uuid="dd88a6d2-cac6-453c-bddd-074cdf43f560">
Nov 10 19:24:54 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:24:54 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:54 user nova-compute[75026]:       </nova:ports>
Nov 10 19:24:54 user nova-compute[75026]:     </nova:instance>
Nov 10 19:24:54 user nova-compute[75026]:   </metadata>
Nov 10 19:24:54 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:24:54 user nova-compute[75026]:     <system>
Nov 10 19:24:54 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:24:54 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:24:54 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:24:54 user nova-compute[75026]:       <entry name="serial">f888a7cc-f582-4e5e-8e70-4fada2e30591</entry>
Nov 10 19:24:54 user nova-compute[75026]:       <entry name="uuid">f888a7cc-f582-4e5e-8e70-4fada2e30591</entry>
Nov 10 19:24:54 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:24:54 user nova-compute[75026]:     </system>
Nov 10 19:24:54 user nova-compute[75026]:   </sysinfo>
Nov 10 19:24:54 user nova-compute[75026]:   <os>
Nov 10 19:24:54 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:24:54 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:24:54 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:24:54 user nova-compute[75026]:   </os>
Nov 10 19:24:54 user nova-compute[75026]:   <features>
Nov 10 19:24:54 user nova-compute[75026]:     <acpi/>
Nov 10 19:24:54 user nova-compute[75026]:     <apic/>
Nov 10 19:24:54 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:24:54 user nova-compute[75026]:   </features>
Nov 10 19:24:54 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:24:54 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:24:54 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:24:54 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:24:54 user nova-compute[75026]:   </clock>
Nov 10 19:24:54 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:24:54 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:24:54 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:24:54 user nova-compute[75026]:   </cpu>
Nov 10 19:24:54 user nova-compute[75026]:   <devices>
Nov 10 19:24:54 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:24:54 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:24:54 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk"/>
Nov 10 19:24:54 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:24:54 user nova-compute[75026]:     </disk>
Nov 10 19:24:54 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:54 user nova-compute[75026]:       <mac address="fa:16:3e:65:80:f9"/>
Nov 10 19:24:54 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:54 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:54 user nova-compute[75026]:       <target dev="tapdd88a6d2-ca"/>
Nov 10 19:24:54 user nova-compute[75026]:     </interface>
Nov 10 19:24:54 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:24:54 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/console.log" append="off"/>
Nov 10 19:24:54 user nova-compute[75026]:     </serial>
Nov 10 19:24:54 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:24:54 user nova-compute[75026]:     <video>
Nov 10 19:24:54 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:54 user nova-compute[75026]:     </video>
Nov 10 19:24:54 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:24:54 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:24:54 user nova-compute[75026]:     </rng>
Nov 10 19:24:54 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:24:54 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:24:54 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:24:54 user nova-compute[75026]:     </memballoon>
Nov 10 19:24:54 user nova-compute[75026]:   </devices>
Nov 10 19:24:54 user nova-compute[75026]: </domain>
Nov 10 19:24:54 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-586203153',display_name='tempest-VolumesSnapshotTestJSON-instance-586203153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-586203153',id=17,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz5k/6fEXDYqd27EN6La0ckHLAMY+FyOYGTb8ROihZHjsjUwyjngJCx8yXWRG8GHGjVJTXQtefA6LWkHRE9zC+9yrw4XV/12Mu3jVEfGI+2FEBRHCMcyU9HcEs4PMC93A==',key_name='tempest-keypair-525285770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ae442a2faf4481a3fb87b1c7ea53bf',ramdisk_id='',reservation_id='r-bx7m7rnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1891642589',owner_user_name='tempest-VolumesSnapshotTestJSON-1891642589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f95e8bc5971d4c06b6755ad1f63c6856',uuid=f888a7cc-f582-4e5e-8e70-4fada2e30591,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converting VIF {"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:80:f9,bridge_name='br-int',has_traffic_filtering=True,id=dd88a6d2-cac6-453c-bddd-074cdf43f560,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd88a6d2-ca') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG os_vif [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:80:f9,bridge_name='br-int',has_traffic_filtering=True,id=dd88a6d2-cac6-453c-bddd-074cdf43f560,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd88a6d2-ca') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8611c5b-3465-544c-9b98-7b550c88b511', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd88a6d2-ca, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd88a6d2-ca, col_values=(('qos', UUID('379d9dcc-d257-41ec-9c29-f9a011f232aa')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd88a6d2-ca, col_values=(('external_ids', {'iface-id': 'dd88a6d2-cac6-453c-bddd-074cdf43f560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:80:f9', 'vm-uuid': 'f888a7cc-f582-4e5e-8e70-4fada2e30591'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:54 user nova-compute[75026]: INFO os_vif [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:80:f9,bridge_name='br-int',has_traffic_filtering=True,id=dd88a6d2-cac6-453c-bddd-074cdf43f560,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd88a6d2-ca')
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No VIF found with MAC fa:16:3e:65:80:f9, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "4bca9e2c-c534-4714-995d-6c58970e7213" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "4bca9e2c-c534-4714-995d-6c58970e7213" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-1e00eff6-7776-4e0f-bb21-4f546d766036 req-fd425a3a-9f58-4770-81cc-036fc65519ea service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updated VIF entry in instance network info cache for port dd88a6d2-cac6-453c-bddd-074cdf43f560. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-1e00eff6-7776-4e0f-bb21-4f546d766036 req-fd425a3a-9f58-4770-81cc-036fc65519ea service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updating instance_info_cache with network_info: [{"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1e00eff6-7776-4e0f-bb21-4f546d766036 req-fd425a3a-9f58-4770-81cc-036fc65519ea service nova] Releasing lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:54 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:24:54 user nova-compute[75026]: INFO nova.compute.claims [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Claim successful on node user
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:55 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.policy [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b959bd7e72f94aeea99e8768167dd00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db33bf19db0840e9b7c5380e5e4ded1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:24:55 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Creating image(s)
Nov 10 19:24:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "/opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "/opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-dfe298a8-3b75-46a8-9d07-49de6a192571 req-e9e85f8e-9376-4236-a5a7-0aedba07c550 service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received event network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dfe298a8-3b75-46a8-9d07-49de6a192571 req-e9e85f8e-9376-4236-a5a7-0aedba07c550 service nova] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dfe298a8-3b75-46a8-9d07-49de6a192571 req-e9e85f8e-9376-4236-a5a7-0aedba07c550 service nova] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dfe298a8-3b75-46a8-9d07-49de6a192571 req-e9e85f8e-9376-4236-a5a7-0aedba07c550 service nova] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-dfe298a8-3b75-46a8-9d07-49de6a192571 req-e9e85f8e-9376-4236-a5a7-0aedba07c550 service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] No waiting events found dispatching network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:55 user nova-compute[75026]: WARNING nova.compute.manager [req-dfe298a8-3b75-46a8-9d07-49de6a192571 req-e9e85f8e-9376-4236-a5a7-0aedba07c550 service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received unexpected event network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 for instance with vm_state building and task_state spawning.
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.268s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Successfully created port: 42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk 1073741824" returned: 0 in 0.086s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.207s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Cannot resize image /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Ensure instance console log exists: /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Successfully updated port: 42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "refresh_cache-4bca9e2c-c534-4714-995d-6c58970e7213" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquired lock "refresh_cache-4bca9e2c-c534-4714-995d-6c58970e7213" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-563b6db8-1d5a-4a75-a7b7-36056eed80f6 req-17975847-7858-4f62-92b8-61bec7bfca6b service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received event network-changed-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-563b6db8-1d5a-4a75-a7b7-36056eed80f6 req-17975847-7858-4f62-92b8-61bec7bfca6b service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Refreshing instance network info cache due to event network-changed-42d693eb-ffff-48ee-80c1-c4c29bcb5945. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-563b6db8-1d5a-4a75-a7b7-36056eed80f6 req-17975847-7858-4f62-92b8-61bec7bfca6b service nova] Acquiring lock "refresh_cache-4bca9e2c-c534-4714-995d-6c58970e7213" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Updating instance_info_cache with network_info: [{"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Releasing lock "refresh_cache-4bca9e2c-c534-4714-995d-6c58970e7213" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Instance network_info: |[{"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-563b6db8-1d5a-4a75-a7b7-36056eed80f6 req-17975847-7858-4f62-92b8-61bec7bfca6b service nova] Acquired lock "refresh_cache-4bca9e2c-c534-4714-995d-6c58970e7213" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.neutron [req-563b6db8-1d5a-4a75-a7b7-36056eed80f6 req-17975847-7858-4f62-92b8-61bec7bfca6b service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Refreshing network info cache for port 42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Start _get_guest_xml network_info=[{"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:24:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-30167434',display_name='tempest-VolumesActionsTest-instance-30167434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-30167434',id=18,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db33bf19db0840e9b7c5380e5e4ded1e',ramdisk_id='',reservation_id='r-j8gg0o8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1781528389',owner_user_name='tempest-VolumesActionsTest-1781528389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:24:56Z,user_data=None,user_id='b959bd7e72f94aeea99e8768167dd00d',uuid=4bca9e2c-c534-4714-995d-6c58970e7213,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Converting VIF {"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:88:be,bridge_name='br-int',has_traffic_filtering=True,id=42d693eb-ffff-48ee-80c1-c4c29bcb5945,network=Network(26c39e6e-878c-4ac1-80b1-e1723b02cb87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d693eb-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bca9e2c-c534-4714-995d-6c58970e7213 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:24:57 user nova-compute[75026]:   <uuid>4bca9e2c-c534-4714-995d-6c58970e7213</uuid>
Nov 10 19:24:57 user nova-compute[75026]:   <name>instance-00000012</name>
Nov 10 19:24:57 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:24:57 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:24:57 user nova-compute[75026]:   <metadata>
Nov 10 19:24:57 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:24:57 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:24:57 user nova-compute[75026]:       <nova:name>tempest-VolumesActionsTest-instance-30167434</nova:name>
Nov 10 19:24:57 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:24:57</nova:creationTime>
Nov 10 19:24:57 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:24:57 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:24:57 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:24:57 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:24:57 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:24:57 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:24:57 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:24:57 user nova-compute[75026]:       <nova:owner>
Nov 10 19:24:57 user nova-compute[75026]:         <nova:user uuid="b959bd7e72f94aeea99e8768167dd00d">tempest-VolumesActionsTest-1781528389-project-member</nova:user>
Nov 10 19:24:57 user nova-compute[75026]:         <nova:project uuid="db33bf19db0840e9b7c5380e5e4ded1e">tempest-VolumesActionsTest-1781528389</nova:project>
Nov 10 19:24:57 user nova-compute[75026]:       </nova:owner>
Nov 10 19:24:57 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:24:57 user nova-compute[75026]:       <nova:ports>
Nov 10 19:24:57 user nova-compute[75026]:         <nova:port uuid="42d693eb-ffff-48ee-80c1-c4c29bcb5945">
Nov 10 19:24:57 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:24:57 user nova-compute[75026]:         </nova:port>
Nov 10 19:24:57 user nova-compute[75026]:       </nova:ports>
Nov 10 19:24:57 user nova-compute[75026]:     </nova:instance>
Nov 10 19:24:57 user nova-compute[75026]:   </metadata>
Nov 10 19:24:57 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:24:57 user nova-compute[75026]:     <system>
Nov 10 19:24:57 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:24:57 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:24:57 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:24:57 user nova-compute[75026]:       <entry name="serial">4bca9e2c-c534-4714-995d-6c58970e7213</entry>
Nov 10 19:24:57 user nova-compute[75026]:       <entry name="uuid">4bca9e2c-c534-4714-995d-6c58970e7213</entry>
Nov 10 19:24:57 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:24:57 user nova-compute[75026]:     </system>
Nov 10 19:24:57 user nova-compute[75026]:   </sysinfo>
Nov 10 19:24:57 user nova-compute[75026]:   <os>
Nov 10 19:24:57 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:24:57 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:24:57 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:24:57 user nova-compute[75026]:   </os>
Nov 10 19:24:57 user nova-compute[75026]:   <features>
Nov 10 19:24:57 user nova-compute[75026]:     <acpi/>
Nov 10 19:24:57 user nova-compute[75026]:     <apic/>
Nov 10 19:24:57 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:24:57 user nova-compute[75026]:   </features>
Nov 10 19:24:57 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:24:57 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:24:57 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:24:57 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:24:57 user nova-compute[75026]:   </clock>
Nov 10 19:24:57 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:24:57 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:24:57 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:24:57 user nova-compute[75026]:   </cpu>
Nov 10 19:24:57 user nova-compute[75026]:   <devices>
Nov 10 19:24:57 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:24:57 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:24:57 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk"/>
Nov 10 19:24:57 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:24:57 user nova-compute[75026]:     </disk>
Nov 10 19:24:57 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:24:57 user nova-compute[75026]:       <mac address="fa:16:3e:51:88:be"/>
Nov 10 19:24:57 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:57 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:24:57 user nova-compute[75026]:       <target dev="tap42d693eb-ff"/>
Nov 10 19:24:57 user nova-compute[75026]:     </interface>
Nov 10 19:24:57 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:24:57 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/console.log" append="off"/>
Nov 10 19:24:57 user nova-compute[75026]:     </serial>
Nov 10 19:24:57 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:24:57 user nova-compute[75026]:     <video>
Nov 10 19:24:57 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:24:57 user nova-compute[75026]:     </video>
Nov 10 19:24:57 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:24:57 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:24:57 user nova-compute[75026]:     </rng>
Nov 10 19:24:57 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:24:57 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:24:57 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:24:57 user nova-compute[75026]:     </memballoon>
Nov 10 19:24:57 user nova-compute[75026]:   </devices>
Nov 10 19:24:57 user nova-compute[75026]: </domain>
Nov 10 19:24:57 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-30167434',display_name='tempest-VolumesActionsTest-instance-30167434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-30167434',id=18,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db33bf19db0840e9b7c5380e5e4ded1e',ramdisk_id='',reservation_id='r-j8gg0o8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1781528389',owner_user_name='tempest-VolumesActionsTest-1781528389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:24:56Z,user_data=None,user_id='b959bd7e72f94aeea99e8768167dd00d',uuid=4bca9e2c-c534-4714-995d-6c58970e7213,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Converting VIF {"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:88:be,bridge_name='br-int',has_traffic_filtering=True,id=42d693eb-ffff-48ee-80c1-c4c29bcb5945,network=Network(26c39e6e-878c-4ac1-80b1-e1723b02cb87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d693eb-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG os_vif [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:88:be,bridge_name='br-int',has_traffic_filtering=True,id=42d693eb-ffff-48ee-80c1-c4c29bcb5945,network=Network(26c39e6e-878c-4ac1-80b1-e1723b02cb87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d693eb-ff') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1b847e8-44fb-5dcc-9c7a-5915a3f30fa7', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42d693eb-ff, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42d693eb-ff, col_values=(('qos', UUID('809c739a-81cb-456b-ab99-fe809afd2a48')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42d693eb-ff, col_values=(('external_ids', {'iface-id': '42d693eb-ffff-48ee-80c1-c4c29bcb5945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:88:be', 'vm-uuid': '4bca9e2c-c534-4714-995d-6c58970e7213'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:57 user nova-compute[75026]: INFO os_vif [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:88:be,bridge_name='br-int',has_traffic_filtering=True,id=42d693eb-ffff-48ee-80c1-c4c29bcb5945,network=Network(26c39e6e-878c-4ac1-80b1-e1723b02cb87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d693eb-ff')
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] No VIF found with MAC fa:16:3e:51:88:be, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.neutron [req-563b6db8-1d5a-4a75-a7b7-36056eed80f6 req-17975847-7858-4f62-92b8-61bec7bfca6b service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Updated VIF entry in instance network info cache for port 42d693eb-ffff-48ee-80c1-c4c29bcb5945. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG nova.network.neutron [req-563b6db8-1d5a-4a75-a7b7-36056eed80f6 req-17975847-7858-4f62-92b8-61bec7bfca6b service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Updating instance_info_cache with network_info: [{"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:24:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-563b6db8-1d5a-4a75-a7b7-36056eed80f6 req-17975847-7858-4f62-92b8-61bec7bfca6b service nova] Releasing lock "refresh_cache-4bca9e2c-c534-4714-995d-6c58970e7213" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.compute.manager [req-c8db15f5-eb25-4f1a-a869-d1a57f51f5c4 req-a903b8be-6e60-491d-b2e7-ce558e8cd4de service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received event network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8db15f5-eb25-4f1a-a869-d1a57f51f5c4 req-a903b8be-6e60-491d-b2e7-ce558e8cd4de service nova] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8db15f5-eb25-4f1a-a869-d1a57f51f5c4 req-a903b8be-6e60-491d-b2e7-ce558e8cd4de service nova] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8db15f5-eb25-4f1a-a869-d1a57f51f5c4 req-a903b8be-6e60-491d-b2e7-ce558e8cd4de service nova] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.compute.manager [req-c8db15f5-eb25-4f1a-a869-d1a57f51f5c4 req-a903b8be-6e60-491d-b2e7-ce558e8cd4de service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] No waiting events found dispatching network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:58 user nova-compute[75026]: WARNING nova.compute.manager [req-c8db15f5-eb25-4f1a-a869-d1a57f51f5c4 req-a903b8be-6e60-491d-b2e7-ce558e8cd4de service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received unexpected event network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 for instance with vm_state building and task_state spawning.
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:24:58 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Instance spawned successfully.
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:24:58 user nova-compute[75026]: INFO nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 10 19:24:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:24:58 user nova-compute[75026]: INFO nova.compute.manager [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Took 7.25 seconds to build instance.
Nov 10 19:24:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c7eef14-389a-4b6b-9653-914bd2be2aed tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.545s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-debc4627-3276-4ce6-b78c-fb89e240c222 req-450bee82-7f7e-4ca9-9bd6-bf98cf7241ba service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received event network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-debc4627-3276-4ce6-b78c-fb89e240c222 req-450bee82-7f7e-4ca9-9bd6-bf98cf7241ba service nova] Acquiring lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-debc4627-3276-4ce6-b78c-fb89e240c222 req-450bee82-7f7e-4ca9-9bd6-bf98cf7241ba service nova] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-debc4627-3276-4ce6-b78c-fb89e240c222 req-450bee82-7f7e-4ca9-9bd6-bf98cf7241ba service nova] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-debc4627-3276-4ce6-b78c-fb89e240c222 req-450bee82-7f7e-4ca9-9bd6-bf98cf7241ba service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] No waiting events found dispatching network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:24:59 user nova-compute[75026]: WARNING nova.compute.manager [req-debc4627-3276-4ce6-b78c-fb89e240c222 req-450bee82-7f7e-4ca9-9bd6-bf98cf7241ba service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received unexpected event network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 for instance with vm_state building and task_state spawning.
Nov 10 19:24:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:24:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:25:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Instance spawned successfully.
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:01 user nova-compute[75026]: INFO nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:25:01 user nova-compute[75026]: INFO nova.compute.manager [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Took 6.63 seconds to build instance.
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-9028574c-4008-4d82-bcad-2ea97ba03c5a req-15297dfe-6d30-4fd4-9f0c-e3635085b5b3 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received event network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9028574c-4008-4d82-bcad-2ea97ba03c5a req-15297dfe-6d30-4fd4-9f0c-e3635085b5b3 service nova] Acquiring lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9028574c-4008-4d82-bcad-2ea97ba03c5a req-15297dfe-6d30-4fd4-9f0c-e3635085b5b3 service nova] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9028574c-4008-4d82-bcad-2ea97ba03c5a req-15297dfe-6d30-4fd4-9f0c-e3635085b5b3 service nova] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-9028574c-4008-4d82-bcad-2ea97ba03c5a req-15297dfe-6d30-4fd4-9f0c-e3635085b5b3 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] No waiting events found dispatching network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:01 user nova-compute[75026]: WARNING nova.compute.manager [req-9028574c-4008-4d82-bcad-2ea97ba03c5a req-15297dfe-6d30-4fd4-9f0c-e3635085b5b3 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received unexpected event network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 for instance with vm_state building and task_state spawning.
Nov 10 19:25:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6ef92e9-2dd6-49e4-9088-2d0087e323a9 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "4bca9e2c-c534-4714-995d-6c58970e7213" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.757s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:25:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:25:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:25:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:25:09 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updating instance_info_cache with network_info: [{"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-0c42552f-3882-4f34-bf6a-fdef6a69e785" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:25:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:25:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:10 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:25:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:25:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:13 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:25:13 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:25:13 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=25.721195220947266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:25:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 31abf353-32fa-4b39-a2b3-02b63976b997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 01641144-84e2-49f1-9d09-6a15a9f42249 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 81632714-289b-469d-a950-55177e8da002 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1cb42234-262e-4c9a-9b30-5315e07b5a42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f888a7cc-f582-4e5e-8e70-4fada2e30591 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4bca9e2c-c534-4714-995d-6c58970e7213 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:25:15 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:25:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "31abf353-32fa-4b39-a2b3-02b63976b997" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "31abf353-32fa-4b39-a2b3-02b63976b997" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "31abf353-32fa-4b39-a2b3-02b63976b997-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:29 user nova-compute[75026]: INFO nova.compute.manager [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Terminating instance
Nov 10 19:25:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:25:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Instance destroyed successfully.
Nov 10 19:25:30 user nova-compute[75026]: DEBUG nova.objects.instance [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lazy-loading 'resources' on Instance uuid 31abf353-32fa-4b39-a2b3-02b63976b997 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1629455314',display_name='tempest-ServersNegativeTestJSON-server-1629455314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1629455314',id=3,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d16cff5b9b94e95b61b63e8ffd25066',ramdisk_id='',reservation_id='r-na1sfunc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-527246051',owner_user_name='tempest-ServersNegativeTestJSON-527246051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:16:24Z,user_data=None,user_id='8448d842ea1f478392fbdb0c27afed56',uuid=31abf353-32fa-4b39-a2b3-02b63976b997,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converting VIF {"id": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "address": "fa:16:3e:09:c3:44", "network": {"id": "4825769a-722b-4048-93d9-c365e14ffe5d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1211214628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d16cff5b9b94e95b61b63e8ffd25066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cd716fa-aa", "ovs_interfaceid": "2cd716fa-aa9c-433e-bfee-4a00514c51d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:c3:44,bridge_name='br-int',has_traffic_filtering=True,id=2cd716fa-aa9c-433e-bfee-4a00514c51d5,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd716fa-aa') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG os_vif [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:c3:44,bridge_name='br-int',has_traffic_filtering=True,id=2cd716fa-aa9c-433e-bfee-4a00514c51d5,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd716fa-aa') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cd716fa-aa, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08226f75-72d5-4a0c-b660-2c0f7b0c321b) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:30 user nova-compute[75026]: INFO os_vif [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:c3:44,bridge_name='br-int',has_traffic_filtering=True,id=2cd716fa-aa9c-433e-bfee-4a00514c51d5,network=Network(4825769a-722b-4048-93d9-c365e14ffe5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cd716fa-aa')
Nov 10 19:25:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Deleting instance files /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997_del
Nov 10 19:25:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Deletion of /opt/stack/data/nova/instances/31abf353-32fa-4b39-a2b3-02b63976b997_del complete
Nov 10 19:25:30 user nova-compute[75026]: INFO nova.compute.manager [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 10 19:25:30 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:25:31 user nova-compute[75026]: INFO nova.compute.claims [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Claim successful on node user
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:25:31 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Took 0.59 seconds to deallocate network for instance.
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-26460f21-b0c0-4299-a16d-875b2f7654d6 req-206454ac-256e-412b-a4a4-8fc22ea50448 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Received event network-vif-deleted-2cd716fa-aa9c-433e-bfee-4a00514c51d5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:31 user nova-compute[75026]: INFO nova.compute.manager [req-26460f21-b0c0-4299-a16d-875b2f7654d6 req-206454ac-256e-412b-a4a4-8fc22ea50448 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Neutron deleted interface 2cd716fa-aa9c-433e-bfee-4a00514c51d5; detaching it from the instance and deleting it from the info cache
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.network.neutron [req-26460f21-b0c0-4299-a16d-875b2f7654d6 req-206454ac-256e-412b-a4a4-8fc22ea50448 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-26460f21-b0c0-4299-a16d-875b2f7654d6 req-206454ac-256e-412b-a4a4-8fc22ea50448 service nova] [instance: 31abf353-32fa-4b39-a2b3-02b63976b997] Detach interface failed, port_id=2cd716fa-aa9c-433e-bfee-4a00514c51d5, reason: Instance 31abf353-32fa-4b39-a2b3-02b63976b997 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:25:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.policy [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcbd2be26ec84b5d9f6f6638963e870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e468483e8f4f70bd228ff8194d76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:25:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Creating image(s)
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "/opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "/opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:32 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Deleted allocations for instance 31abf353-32fa-4b39-a2b3-02b63976b997
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-17e5e721-1bc0-47dc-9c2e-6e8314669665 tempest-ServersNegativeTestJSON-527246051 tempest-ServersNegativeTestJSON-527246051-project-member] Lock "31abf353-32fa-4b39-a2b3-02b63976b997" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.217s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk 1073741824" returned: 0 in 0.061s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Successfully created port: 73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Cannot resize image /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Ensure instance console log exists: /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Successfully updated port: 73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquired lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-a276deba-ee7d-4cc6-8254-9ace9e7f821d req-a38e7bdf-68fa-472b-8c09-9bfc357851d9 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received event network-changed-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-a276deba-ee7d-4cc6-8254-9ace9e7f821d req-a38e7bdf-68fa-472b-8c09-9bfc357851d9 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Refreshing instance network info cache due to event network-changed-73693a79-982a-43ec-8930-07bc70a2033b. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a276deba-ee7d-4cc6-8254-9ace9e7f821d req-a38e7bdf-68fa-472b-8c09-9bfc357851d9 service nova] Acquiring lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updating instance_info_cache with network_info: [{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Releasing lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Instance network_info: |[{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a276deba-ee7d-4cc6-8254-9ace9e7f821d req-a38e7bdf-68fa-472b-8c09-9bfc357851d9 service nova] Acquired lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.neutron [req-a276deba-ee7d-4cc6-8254-9ace9e7f821d req-a38e7bdf-68fa-472b-8c09-9bfc357851d9 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Refreshing network info cache for port 73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Start _get_guest_xml network_info=[{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:25:33 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:25:33 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1489498903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1489498903',id=19,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-aypge11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:25:32Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=b9e39b1a-3119-456e-b16d-192dbcd66ae3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:3f:9a,bridge_name='br-int',has_traffic_filtering=True,id=73693a79-982a-43ec-8930-07bc70a2033b,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73693a79-98') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'pci_devices' on Instance uuid b9e39b1a-3119-456e-b16d-192dbcd66ae3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:25:33 user nova-compute[75026]:   <uuid>b9e39b1a-3119-456e-b16d-192dbcd66ae3</uuid>
Nov 10 19:25:33 user nova-compute[75026]:   <name>instance-00000013</name>
Nov 10 19:25:33 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:25:33 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:25:33 user nova-compute[75026]:   <metadata>
Nov 10 19:25:33 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:25:33 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:25:33 user nova-compute[75026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1489498903</nova:name>
Nov 10 19:25:33 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:25:33</nova:creationTime>
Nov 10 19:25:33 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:25:33 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:25:33 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:25:33 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:25:33 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:25:33 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:25:33 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:25:33 user nova-compute[75026]:       <nova:owner>
Nov 10 19:25:33 user nova-compute[75026]:         <nova:user uuid="fcbd2be26ec84b5d9f6f6638963e870e">tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member</nova:user>
Nov 10 19:25:33 user nova-compute[75026]:         <nova:project uuid="43e468483e8f4f70bd228ff8194d76b7">tempest-ServerBootFromVolumeStableRescueTest-1118157225</nova:project>
Nov 10 19:25:33 user nova-compute[75026]:       </nova:owner>
Nov 10 19:25:33 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:25:33 user nova-compute[75026]:       <nova:ports>
Nov 10 19:25:33 user nova-compute[75026]:         <nova:port uuid="73693a79-982a-43ec-8930-07bc70a2033b">
Nov 10 19:25:33 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 19:25:33 user nova-compute[75026]:         </nova:port>
Nov 10 19:25:33 user nova-compute[75026]:       </nova:ports>
Nov 10 19:25:33 user nova-compute[75026]:     </nova:instance>
Nov 10 19:25:33 user nova-compute[75026]:   </metadata>
Nov 10 19:25:33 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:25:33 user nova-compute[75026]:     <system>
Nov 10 19:25:33 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:25:33 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:25:33 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:25:33 user nova-compute[75026]:       <entry name="serial">b9e39b1a-3119-456e-b16d-192dbcd66ae3</entry>
Nov 10 19:25:33 user nova-compute[75026]:       <entry name="uuid">b9e39b1a-3119-456e-b16d-192dbcd66ae3</entry>
Nov 10 19:25:33 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:25:33 user nova-compute[75026]:     </system>
Nov 10 19:25:33 user nova-compute[75026]:   </sysinfo>
Nov 10 19:25:33 user nova-compute[75026]:   <os>
Nov 10 19:25:33 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:25:33 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:25:33 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:25:33 user nova-compute[75026]:   </os>
Nov 10 19:25:33 user nova-compute[75026]:   <features>
Nov 10 19:25:33 user nova-compute[75026]:     <acpi/>
Nov 10 19:25:33 user nova-compute[75026]:     <apic/>
Nov 10 19:25:33 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:25:33 user nova-compute[75026]:   </features>
Nov 10 19:25:33 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:25:33 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:25:33 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:25:33 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:25:33 user nova-compute[75026]:   </clock>
Nov 10 19:25:33 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:25:33 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:25:33 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:25:33 user nova-compute[75026]:   </cpu>
Nov 10 19:25:33 user nova-compute[75026]:   <devices>
Nov 10 19:25:33 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:25:33 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:25:33 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk"/>
Nov 10 19:25:33 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:25:33 user nova-compute[75026]:     </disk>
Nov 10 19:25:33 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:25:33 user nova-compute[75026]:       <mac address="fa:16:3e:07:3f:9a"/>
Nov 10 19:25:33 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:25:33 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:25:33 user nova-compute[75026]:       <target dev="tap73693a79-98"/>
Nov 10 19:25:33 user nova-compute[75026]:     </interface>
Nov 10 19:25:33 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:25:33 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/console.log" append="off"/>
Nov 10 19:25:33 user nova-compute[75026]:     </serial>
Nov 10 19:25:33 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:25:33 user nova-compute[75026]:     <video>
Nov 10 19:25:33 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:25:33 user nova-compute[75026]:     </video>
Nov 10 19:25:33 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:25:33 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:25:33 user nova-compute[75026]:     </rng>
Nov 10 19:25:33 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:25:33 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:25:33 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:25:33 user nova-compute[75026]:     </memballoon>
Nov 10 19:25:33 user nova-compute[75026]:   </devices>
Nov 10 19:25:33 user nova-compute[75026]: </domain>
Nov 10 19:25:33 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1489498903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1489498903',id=19,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-aypge11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:25:32Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=b9e39b1a-3119-456e-b16d-192dbcd66ae3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:3f:9a,bridge_name='br-int',has_traffic_filtering=True,id=73693a79-982a-43ec-8930-07bc70a2033b,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73693a79-98') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG os_vif [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:3f:9a,bridge_name='br-int',has_traffic_filtering=True,id=73693a79-982a-43ec-8930-07bc70a2033b,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73693a79-98') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebdd85f5-e64e-509f-80fb-3e292282f31e', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73693a79-98, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73693a79-98, col_values=(('qos', UUID('1e0fc991-70c9-4c87-90ba-65e04a9202c0')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73693a79-98, col_values=(('external_ids', {'iface-id': '73693a79-982a-43ec-8930-07bc70a2033b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:3f:9a', 'vm-uuid': 'b9e39b1a-3119-456e-b16d-192dbcd66ae3'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:33 user nova-compute[75026]: INFO os_vif [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:3f:9a,bridge_name='br-int',has_traffic_filtering=True,id=73693a79-982a-43ec-8930-07bc70a2033b,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73693a79-98')
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:25:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No VIF found with MAC fa:16:3e:07:3f:9a, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:25:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-a276deba-ee7d-4cc6-8254-9ace9e7f821d req-a38e7bdf-68fa-472b-8c09-9bfc357851d9 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updated VIF entry in instance network info cache for port 73693a79-982a-43ec-8930-07bc70a2033b. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:25:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-a276deba-ee7d-4cc6-8254-9ace9e7f821d req-a38e7bdf-68fa-472b-8c09-9bfc357851d9 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updating instance_info_cache with network_info: [{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a276deba-ee7d-4cc6-8254-9ace9e7f821d req-a38e7bdf-68fa-472b-8c09-9bfc357851d9 service nova] Releasing lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-4492b242-965d-4514-a5c4-a32f2c23f191 req-2d81fb49-fbda-4e76-868a-aa5514b3ef66 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received event network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4492b242-965d-4514-a5c4-a32f2c23f191 req-2d81fb49-fbda-4e76-868a-aa5514b3ef66 service nova] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4492b242-965d-4514-a5c4-a32f2c23f191 req-2d81fb49-fbda-4e76-868a-aa5514b3ef66 service nova] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4492b242-965d-4514-a5c4-a32f2c23f191 req-2d81fb49-fbda-4e76-868a-aa5514b3ef66 service nova] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-4492b242-965d-4514-a5c4-a32f2c23f191 req-2d81fb49-fbda-4e76-868a-aa5514b3ef66 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] No waiting events found dispatching network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:35 user nova-compute[75026]: WARNING nova.compute.manager [req-4492b242-965d-4514-a5c4-a32f2c23f191 req-2d81fb49-fbda-4e76-868a-aa5514b3ef66 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received unexpected event network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b for instance with vm_state building and task_state spawning.
Nov 10 19:25:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:25:37 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Instance spawned successfully.
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:25:37 user nova-compute[75026]: INFO nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:25:37 user nova-compute[75026]: INFO nova.compute.manager [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Took 6.57 seconds to build instance.
Nov 10 19:25:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f489c541-a73f-4a7b-9afc-bea56b3dda42 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.676s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-fe5061bd-2806-4b69-8458-308585aae5bb req-39a1a894-ccdf-4167-b180-13265acbe534 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received event network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fe5061bd-2806-4b69-8458-308585aae5bb req-39a1a894-ccdf-4167-b180-13265acbe534 service nova] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fe5061bd-2806-4b69-8458-308585aae5bb req-39a1a894-ccdf-4167-b180-13265acbe534 service nova] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fe5061bd-2806-4b69-8458-308585aae5bb req-39a1a894-ccdf-4167-b180-13265acbe534 service nova] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-fe5061bd-2806-4b69-8458-308585aae5bb req-39a1a894-ccdf-4167-b180-13265acbe534 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] No waiting events found dispatching network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:37 user nova-compute[75026]: WARNING nova.compute.manager [req-fe5061bd-2806-4b69-8458-308585aae5bb req-39a1a894-ccdf-4167-b180-13265acbe534 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received unexpected event network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b for instance with vm_state active and task_state None.
Nov 10 19:25:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-9185560c-e15b-4580-a8be-7c3ceba7beb4 req-c56fe417-b09b-493e-8bf6-4c5c6f8e7ccd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-changed-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-9185560c-e15b-4580-a8be-7c3ceba7beb4 req-c56fe417-b09b-493e-8bf6-4c5c6f8e7ccd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing instance network info cache due to event network-changed-16e124c7-2ea9-4337-9d56-62d8bea0431a. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:25:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9185560c-e15b-4580-a8be-7c3ceba7beb4 req-c56fe417-b09b-493e-8bf6-4c5c6f8e7ccd service nova] Acquiring lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:25:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9185560c-e15b-4580-a8be-7c3ceba7beb4 req-c56fe417-b09b-493e-8bf6-4c5c6f8e7ccd service nova] Acquired lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:25:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-9185560c-e15b-4580-a8be-7c3ceba7beb4 req-c56fe417-b09b-493e-8bf6-4c5c6f8e7ccd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Refreshing network info cache for port 16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:25:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-9185560c-e15b-4580-a8be-7c3ceba7beb4 req-c56fe417-b09b-493e-8bf6-4c5c6f8e7ccd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updated VIF entry in instance network info cache for port 16e124c7-2ea9-4337-9d56-62d8bea0431a. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:25:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-9185560c-e15b-4580-a8be-7c3ceba7beb4 req-c56fe417-b09b-493e-8bf6-4c5c6f8e7ccd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [{"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9185560c-e15b-4580-a8be-7c3ceba7beb4 req-c56fe417-b09b-493e-8bf6-4c5c6f8e7ccd service nova] Releasing lock "refresh_cache-81632714-289b-469d-a950-55177e8da002" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:25:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "81632714-289b-469d-a950-55177e8da002" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "81632714-289b-469d-a950-55177e8da002" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:44 user nova-compute[75026]: INFO nova.compute.manager [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Terminating instance
Nov 10 19:25:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-d05aa575-7977-4a22-8804-3d94efd50158 req-bcc12604-3001-49a9-b3c4-34a12bc48930 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d05aa575-7977-4a22-8804-3d94efd50158 req-bcc12604-3001-49a9-b3c4-34a12bc48930 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d05aa575-7977-4a22-8804-3d94efd50158 req-bcc12604-3001-49a9-b3c4-34a12bc48930 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d05aa575-7977-4a22-8804-3d94efd50158 req-bcc12604-3001-49a9-b3c4-34a12bc48930 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-d05aa575-7977-4a22-8804-3d94efd50158 req-bcc12604-3001-49a9-b3c4-34a12bc48930 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-unplugged-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-d05aa575-7977-4a22-8804-3d94efd50158 req-bcc12604-3001-49a9-b3c4-34a12bc48930 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-16e124c7-2ea9-4337-9d56-62d8bea0431a for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-8669d0cb-030d-4005-b391-845b7d397cd3 req-b47081be-ad3b-456d-95aa-0429443bb1e0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8669d0cb-030d-4005-b391-845b7d397cd3 req-b47081be-ad3b-456d-95aa-0429443bb1e0 service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8669d0cb-030d-4005-b391-845b7d397cd3 req-b47081be-ad3b-456d-95aa-0429443bb1e0 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8669d0cb-030d-4005-b391-845b7d397cd3 req-b47081be-ad3b-456d-95aa-0429443bb1e0 service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-8669d0cb-030d-4005-b391-845b7d397cd3 req-b47081be-ad3b-456d-95aa-0429443bb1e0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-unplugged-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-8669d0cb-030d-4005-b391-845b7d397cd3 req-b47081be-ad3b-456d-95aa-0429443bb1e0 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-4be4ceac-647c-47f9-b45d-f6328bd93528 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 81632714-289b-469d-a950-55177e8da002] Instance destroyed successfully.
Nov 10 19:25:46 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lazy-loading 'resources' on Instance uuid 81632714-289b-469d-a950-55177e8da002 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:d5:d5,bridge_name='br-int',has_traffic_filtering=True,id=16e124c7-2ea9-4337-9d56-62d8bea0431a,network=Network(92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e124c7-2e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:d5:d5,bridge_name='br-int',has_traffic_filtering=True,id=16e124c7-2ea9-4337-9d56-62d8bea0431a,network=Network(92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e124c7-2e') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16e124c7-2e, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b267b719-54d1-48c6-beea-7f67dd516f9a) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: INFO os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:d5:d5,bridge_name='br-int',has_traffic_filtering=True,id=16e124c7-2ea9-4337-9d56-62d8bea0431a,network=Network(92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e124c7-2e')
Nov 10 19:25:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1b:4b,bridge_name='br-int',has_traffic_filtering=True,id=c07ef6df-4bdd-462f-8830-62315eff1120,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc07ef6df-4b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1b:4b,bridge_name='br-int',has_traffic_filtering=True,id=c07ef6df-4bdd-462f-8830-62315eff1120,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc07ef6df-4b') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc07ef6df-4b, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a50e68ba-9022-4853-ae8e-7d9ca8232df7) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: INFO os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1b:4b,bridge_name='br-int',has_traffic_filtering=True,id=c07ef6df-4bdd-462f-8830-62315eff1120,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc07ef6df-4b')
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7b:df,bridge_name='br-int',has_traffic_filtering=True,id=4be4ceac-647c-47f9-b45d-f6328bd93528,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4be4ceac-64') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7b:df,bridge_name='br-int',has_traffic_filtering=True,id=4be4ceac-647c-47f9-b45d-f6328bd93528,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4be4ceac-64') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4be4ceac-64, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa4c6284-05d5-403a-a1bc-1c68851afcc7) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: INFO os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7b:df,bridge_name='br-int',has_traffic_filtering=True,id=4be4ceac-647c-47f9-b45d-f6328bd93528,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4be4ceac-64')
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=69944cbd-fa51-494a-ad15-fd84fa1d2cc1,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69944cbd-fa') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=69944cbd-fa51-494a-ad15-fd84fa1d2cc1,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69944cbd-fa') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69944cbd-fa, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bbcd4c8-56e5-43ed-a8c2-c02e9f433a95) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: INFO os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:21:3b,bridge_name='br-int',has_traffic_filtering=True,id=69944cbd-fa51-494a-ad15-fd84fa1d2cc1,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69944cbd-fa')
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:72,bridge_name='br-int',has_traffic_filtering=True,id=00869544-9765-46a7-8c86-382d13a0437b,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00869544-97') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:72,bridge_name='br-int',has_traffic_filtering=True,id=00869544-9765-46a7-8c86-382d13a0437b,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00869544-97') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00869544-97, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-16e124c7-2ea9-4337-9d56-62d8bea0431a for instance with vm_state active and task_state deleting.
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-unplugged-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-c07ef6df-4bdd-462f-8830-62315eff1120 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-c07ef6df-4bdd-462f-8830-62315eff1120 for instance with vm_state active and task_state deleting.
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-unplugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 for instance with vm_state active and task_state deleting.
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-unplugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING nova.compute.manager [req-b58ec814-4001-4f1e-8280-fc6d7c71f300 req-f79a2d1e-e92d-4176-8d65-2e5b2ff6279d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 for instance with vm_state active and task_state deleting.
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2ce8910-9cce-4145-a69f-cead392b155d) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: INFO os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:06:72,bridge_name='br-int',has_traffic_filtering=True,id=00869544-9765-46a7-8c86-382d13a0437b,network=Network(cdafa2a5-1daa-4e9a-9446-a167aacf3c9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00869544-97')
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=f4ea19cf-911c-4337-8a7c-e4bfea3417f5,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ea19cf-91') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=f4ea19cf-911c-4337-8a7c-e4bfea3417f5,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ea19cf-91') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4ea19cf-91, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cd1f01c-0fdc-4ad8-9731-ca3928b1a3d5) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: INFO os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:72:2a,bridge_name='br-int',has_traffic_filtering=True,id=f4ea19cf-911c-4337-8a7c-e4bfea3417f5,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ea19cf-91')
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1127535927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1127535927',id=15,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs/PK4hGY9H3OgcU8yPijemucnSYpjwvGnCjLzHv64UAgOIpGqyWsIUsUImZPI4U3m6oT70dVimwJj/b/p3lFzYU1MMnSLdPZkf6BSUwgep2gAAMldI1DT7xIIp4XioNg==',key_name='tempest-keypair-2105362224',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b56289216442ea891dd09bd4fb4c2f',ramdisk_id='',reservation_id='r-97lfv3y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1121871639',owner_user_name='tempest-TaggedBootDevicesTest_v242-1121871639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87425e99fab14d518648ac5d5ffd1477',uuid=81632714-289b-469d-a950-55177e8da002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converting VIF {"id": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "address": "fa:16:3e:77:3e:27", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f71ce16-64", "ovs_interfaceid": "7f71ce16-64dc-41a0-bf60-e0afb8b6efe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:27,bridge_name='br-int',has_traffic_filtering=True,id=7f71ce16-64dc-41a0-bf60-e0afb8b6efe9,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f71ce16-64') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:27,bridge_name='br-int',has_traffic_filtering=True,id=7f71ce16-64dc-41a0-bf60-e0afb8b6efe9,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f71ce16-64') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f71ce16-64, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a9bc59b-7ff8-4dec-9802-6610da3f4cd0) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:47 user nova-compute[75026]: INFO os_vif [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:3e:27,bridge_name='br-int',has_traffic_filtering=True,id=7f71ce16-64dc-41a0-bf60-e0afb8b6efe9,network=Network(71d4c304-4f0e-4481-a0ec-b13f34c3ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f71ce16-64')
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wILUbrBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef433a9-776c-48a7-b5dd-b357fae8da9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:25:47 user nova-compute[75026]: No targets found.
Nov 10 19:25:47 user nova-compute[75026]: iSNS:
Nov 10 19:25:47 user nova-compute[75026]: No targets found.
Nov 10 19:25:47 user nova-compute[75026]: STATIC:
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: FIRMWARE:
Nov 10 19:25:47 user nova-compute[75026]: No targets found.
Nov 10 19:25:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:25:47 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:25:47 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f15d64-c20b-46c0-a330-1e2e600e302c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7adf31f-aac5-470a-9937-e7c0fab491cb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda7ac6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[42acb6d8-9b6b-43f1-9caa-ac5a2d25e0f4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e415713e-3c47-4898-ae56-8665db1bd005]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ff86e1-f0ff-417f-937a-1fd70792a144]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-4be4ceac-647c-47f9-b45d-f6328bd93528 for instance with vm_state active and task_state deleting.
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-unplugged-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-00869544-9765-46a7-8c86-382d13a0437b for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-00869544-9765-46a7-8c86-382d13a0437b for instance with vm_state active and task_state deleting.
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-unplugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-unplugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Acquiring lock "81632714-289b-469d-a950-55177e8da002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] Lock "81632714-289b-469d-a950-55177e8da002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] No waiting events found dispatching network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING nova.compute.manager [req-723f9902-efd2-423a-81f3-9771ebac4309 req-6e094f96-4d5d-4bb6-8267-62b9541a1f8d service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received unexpected event network-vif-plugged-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 for instance with vm_state active and task_state deleting.
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb961d4-108c-412d-91f9-b25955a66aa6]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2d4aea-d6c4-443d-87c5-af784a327f8d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e81fa7-f190-40f7-9d55-67507445c92e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f, portal: 172.16.0.220,3260]
Nov 10 19:25:47 user nova-compute[75026]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f, portal: 172.16.0.220,3260] successful.
Nov 10 19:25:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d7334ee-4cf5-4a1f-9bf1-774487ea757f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fabba5-514b-4818-ae03-b286a28d1fb8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== disconnect_volume: return (361ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbwSAoXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:25:47 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d3b53e-5e6e-488a-bddc-7aaf74a32ad8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:25:47 user nova-compute[75026]: No targets found.
Nov 10 19:25:47 user nova-compute[75026]: iSNS:
Nov 10 19:25:47 user nova-compute[75026]: No targets found.
Nov 10 19:25:47 user nova-compute[75026]: STATIC:
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8
Nov 10 19:25:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:47 user nova-compute[75026]: FIRMWARE:
Nov 10 19:25:47 user nova-compute[75026]: No targets found.
Nov 10 19:25:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:25:47 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:25:47 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48da0b4-3d0b-4897-8fa4-769ecc5b3556]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3251e515-e419-47f3-948e-f2b1390c5860]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:25:47 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:25:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda7ac6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2'): ({'sde'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Removing single pathed devices sde {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec50d04-ae8b-4d03-91aa-1e24405fb48b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3c80d7-1d3f-44c8-a9cb-76ff4f0a2c4f]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Flushing IO for device /dev/sde {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b12edc-4fd3-467c-bead-317bc2a06de4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eb351c-4fd2-48f3-9929-1c3dba70f782]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] SCSI volumes sde have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58844c8-8db2-48b3-a702-8873e49a579b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f599b0-ada3-4b62-a4e8-4e1e38bb8167]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2, portal: 172.16.0.220,3260]
Nov 10 19:25:48 user nova-compute[75026]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2, portal: 172.16.0.220,3260] successful.
Nov 10 19:25:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94378a27-6898-4d77-9e0d-fa136aad1fe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeca445-a4fc-408b-8cbd-e93fb5b10bdf]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== disconnect_volume: return (319ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbzwxhrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:25:48 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2349f1-a79a-4f21-b4de-f06d85c7b83a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:25:48 user nova-compute[75026]: No targets found.
Nov 10 19:25:48 user nova-compute[75026]: iSNS:
Nov 10 19:25:48 user nova-compute[75026]: No targets found.
Nov 10 19:25:48 user nova-compute[75026]: STATIC:
Nov 10 19:25:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89
Nov 10 19:25:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d
Nov 10 19:25:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765
Nov 10 19:25:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:25:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8
Nov 10 19:25:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:25:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:25:48 user nova-compute[75026]: FIRMWARE:
Nov 10 19:25:48 user nova-compute[75026]: No targets found.
Nov 10 19:25:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:25:48 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:25:48 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fab596-cfb4-4e23-86a2-029a86664e6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa65ea9-b5fc-40ff-a61f-7b6f3f99b774]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:25:48 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:25:48 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:25:48 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:25:48 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:25:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:25:48 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:25:48 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:25:48 user nova-compute[75026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d (non-flash)
Nov 10 19:25:48 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:25:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0e300d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d'): ({'sdg'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Removing single pathed devices sdg {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bf6321-7f5a-4e84-ae0e-8fa972cab84a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af633b1e-7145-48b6-ba00-3dc527970734]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Flushing IO for device /dev/sdg {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f389962-f580-4f34-813d-dbeeda51e548]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c79e535-0b66-47bd-aff8-a5ab82f3391a]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] SCSI volumes sdg have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c76989f-7910-419a-a60d-16fa7ba828c9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44aebee-4474-48d0-95ea-e5c856edcd31]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d, portal: 172.16.0.220,3260]
Nov 10 19:25:48 user nova-compute[75026]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d, portal: 172.16.0.220,3260] successful.
Nov 10 19:25:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd886d4-c3da-4715-bf66-2cc2e13ad42d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[997604c3-4364-4f23-919e-8de4fd550829]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] <== disconnect_volume: return (310ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:25:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Deleting instance files /opt/stack/data/nova/instances/81632714-289b-469d-a950-55177e8da002_del
Nov 10 19:25:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Deletion of /opt/stack/data/nova/instances/81632714-289b-469d-a950-55177e8da002_del complete
Nov 10 19:25:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:48 user nova-compute[75026]: INFO nova.compute.manager [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Took 3.79 seconds to destroy the instance on the hypervisor.
Nov 10 19:25:48 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 81632714-289b-469d-a950-55177e8da002] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:25:48 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 81632714-289b-469d-a950-55177e8da002] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:25:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-b29a3c73-1076-4ba5-9d30-6b463e476bca req-03987439-f521-4c5a-a2bc-bfc0ef42ec43 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-deleted-7f71ce16-64dc-41a0-bf60-e0afb8b6efe9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:50 user nova-compute[75026]: INFO nova.compute.manager [req-b29a3c73-1076-4ba5-9d30-6b463e476bca req-03987439-f521-4c5a-a2bc-bfc0ef42ec43 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Neutron deleted interface 7f71ce16-64dc-41a0-bf60-e0afb8b6efe9; detaching it from the instance and deleting it from the info cache
Nov 10 19:25:50 user nova-compute[75026]: DEBUG nova.network.neutron [req-b29a3c73-1076-4ba5-9d30-6b463e476bca req-03987439-f521-4c5a-a2bc-bfc0ef42ec43 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [{"id": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "address": "fa:16:3e:db:d5:d5", "network": {"id": "92d69a8b-8fd5-41e9-bf34-0a2f4eb9f838", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1642651788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e124c7-2e", "ovs_interfaceid": "16e124c7-2ea9-4337-9d56-62d8bea0431a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c07ef6df-4bdd-462f-8830-62315eff1120", "address": "fa:16:3e:d4:1b:4b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc07ef6df-4b", "ovs_interfaceid": "c07ef6df-4bdd-462f-8830-62315eff1120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4be4ceac-647c-47f9-b45d-f6328bd93528", "address": "fa:16:3e:57:7b:df", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be4ceac-64", "ovs_interfaceid": "4be4ceac-647c-47f9-b45d-f6328bd93528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "address": "fa:16:3e:be:21:3b", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69944cbd-fa", "ovs_interfaceid": "69944cbd-fa51-494a-ad15-fd84fa1d2cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00869544-9765-46a7-8c86-382d13a0437b", "address": "fa:16:3e:0c:06:72", "network": {"id": "cdafa2a5-1daa-4e9a-9446-a167aacf3c9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1343221105", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00869544-97", "ovs_interfaceid": "00869544-9765-46a7-8c86-382d13a0437b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "address": "fa:16:3e:94:72:2a", "network": {"id": "71d4c304-4f0e-4481-a0ec-b13f34c3ac86", "bridge": "br-int", "label": "tempest-device-tagging-net2-2094773493", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c7b56289216442ea891dd09bd4fb4c2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ea19cf-91", "ovs_interfaceid": "f4ea19cf-911c-4337-8a7c-e4bfea3417f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-b29a3c73-1076-4ba5-9d30-6b463e476bca req-03987439-f521-4c5a-a2bc-bfc0ef42ec43 service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Detach interface failed, port_id=7f71ce16-64dc-41a0-bf60-e0afb8b6efe9, reason: Instance 81632714-289b-469d-a950-55177e8da002 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:25:52 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 81632714-289b-469d-a950-55177e8da002] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:52 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 81632714-289b-469d-a950-55177e8da002] Took 3.40 seconds to deallocate network for instance.
Nov 10 19:25:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-d13b790b-1810-4cfa-a48f-c1b21cc378f7 req-e7f2b5cd-8a61-43db-9581-eaf6c0e9d3fd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-deleted-69944cbd-fa51-494a-ad15-fd84fa1d2cc1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-d13b790b-1810-4cfa-a48f-c1b21cc378f7 req-e7f2b5cd-8a61-43db-9581-eaf6c0e9d3fd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-deleted-00869544-9765-46a7-8c86-382d13a0437b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-d13b790b-1810-4cfa-a48f-c1b21cc378f7 req-e7f2b5cd-8a61-43db-9581-eaf6c0e9d3fd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-deleted-16e124c7-2ea9-4337-9d56-62d8bea0431a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-d13b790b-1810-4cfa-a48f-c1b21cc378f7 req-e7f2b5cd-8a61-43db-9581-eaf6c0e9d3fd service nova] [instance: 81632714-289b-469d-a950-55177e8da002] Received event network-vif-deleted-f4ea19cf-911c-4337-8a7c-e4bfea3417f5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:54 user nova-compute[75026]: DEBUG nova.compute.manager [req-dfca79c2-5b52-4372-bb13-1b6f014e515a req-2af4e7cb-8da6-40d9-8860-193206782303 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-changed-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:54 user nova-compute[75026]: DEBUG nova.compute.manager [req-dfca79c2-5b52-4372-bb13-1b6f014e515a req-2af4e7cb-8da6-40d9-8860-193206782303 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Refreshing instance network info cache due to event network-changed-b04da179-c3e9-4063-b77f-2c8c8a43801f. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:25:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dfca79c2-5b52-4372-bb13-1b6f014e515a req-2af4e7cb-8da6-40d9-8860-193206782303 service nova] Acquiring lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:25:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dfca79c2-5b52-4372-bb13-1b6f014e515a req-2af4e7cb-8da6-40d9-8860-193206782303 service nova] Acquired lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:25:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-dfca79c2-5b52-4372-bb13-1b6f014e515a req-2af4e7cb-8da6-40d9-8860-193206782303 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Refreshing network info cache for port b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:25:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-dfca79c2-5b52-4372-bb13-1b6f014e515a req-2af4e7cb-8da6-40d9-8860-193206782303 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updated VIF entry in instance network info cache for port b04da179-c3e9-4063-b77f-2c8c8a43801f. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:25:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-dfca79c2-5b52-4372-bb13-1b6f014e515a req-2af4e7cb-8da6-40d9-8860-193206782303 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updating instance_info_cache with network_info: [{"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dfca79c2-5b52-4372-bb13-1b6f014e515a req-2af4e7cb-8da6-40d9-8860-193206782303 service nova] Releasing lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:25:55 user nova-compute[75026]: INFO nova.compute.manager [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] [instance: 81632714-289b-469d-a950-55177e8da002] Took 3.02 seconds to detach 3 volumes for instance.
Nov 10 19:25:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:55 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:25:55 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:25:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:55 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Deleted allocations for instance 81632714-289b-469d-a950-55177e8da002
Nov 10 19:25:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5211cc92-7589-46de-82e3-5433116fb1fc tempest-TaggedBootDevicesTest_v242-1121871639 tempest-TaggedBootDevicesTest_v242-1121871639-project-member] Lock "81632714-289b-469d-a950-55177e8da002" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.693s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "9be62b33-875c-490a-ab9f-a2e8451feac4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "9be62b33-875c-490a-ab9f-a2e8451feac4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:25:56 user nova-compute[75026]: INFO nova.compute.claims [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Claim successful on node user
Nov 10 19:25:56 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:25:56 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:25:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:25:56 user nova-compute[75026]: DEBUG nova.policy [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '758478b59f94467898696fa7af7cd630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e509e662d27146fba4f51fd55dbe6f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:25:56 user nova-compute[75026]: INFO nova.virt.block_device [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Booting with volume snapshot 1d5f774c-44d7-4e77-a6bd-41ee1a119197 at /dev/vda
Nov 10 19:25:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Successfully created port: 791d5ba8-656f-4176-bf36-d6aec3630a46 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Successfully updated port: 791d5ba8-656f-4176-bf36-d6aec3630a46 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "refresh_cache-9be62b33-875c-490a-ab9f-a2e8451feac4" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquired lock "refresh_cache-9be62b33-875c-490a-ab9f-a2e8451feac4" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-f4efc643-9989-4bda-91c1-801a042aaef4 req-06c9a993-1b19-4b52-8df3-56b62bbf960b service nova] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Received event network-changed-791d5ba8-656f-4176-bf36-d6aec3630a46 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-f4efc643-9989-4bda-91c1-801a042aaef4 req-06c9a993-1b19-4b52-8df3-56b62bbf960b service nova] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Refreshing instance network info cache due to event network-changed-791d5ba8-656f-4176-bf36-d6aec3630a46. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f4efc643-9989-4bda-91c1-801a042aaef4 req-06c9a993-1b19-4b52-8df3-56b62bbf960b service nova] Acquiring lock "refresh_cache-9be62b33-875c-490a-ab9f-a2e8451feac4" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:25:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Updating instance_info_cache with network_info: [{"id": "791d5ba8-656f-4176-bf36-d6aec3630a46", "address": "fa:16:3e:87:6a:ec", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791d5ba8-65", "ovs_interfaceid": "791d5ba8-656f-4176-bf36-d6aec3630a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Releasing lock "refresh_cache-9be62b33-875c-490a-ab9f-a2e8451feac4" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Instance network_info: |[{"id": "791d5ba8-656f-4176-bf36-d6aec3630a46", "address": "fa:16:3e:87:6a:ec", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791d5ba8-65", "ovs_interfaceid": "791d5ba8-656f-4176-bf36-d6aec3630a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f4efc643-9989-4bda-91c1-801a042aaef4 req-06c9a993-1b19-4b52-8df3-56b62bbf960b service nova] Acquired lock "refresh_cache-9be62b33-875c-490a-ab9f-a2e8451feac4" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG nova.network.neutron [req-f4efc643-9989-4bda-91c1-801a042aaef4 req-06c9a993-1b19-4b52-8df3-56b62bbf960b service nova] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Refreshing network info cache for port 791d5ba8-656f-4176-bf36-d6aec3630a46 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG nova.network.neutron [req-f4efc643-9989-4bda-91c1-801a042aaef4 req-06c9a993-1b19-4b52-8df3-56b62bbf960b service nova] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Updated VIF entry in instance network info cache for port 791d5ba8-656f-4176-bf36-d6aec3630a46. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG nova.network.neutron [req-f4efc643-9989-4bda-91c1-801a042aaef4 req-06c9a993-1b19-4b52-8df3-56b62bbf960b service nova] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Updating instance_info_cache with network_info: [{"id": "791d5ba8-656f-4176-bf36-d6aec3630a46", "address": "fa:16:3e:87:6a:ec", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791d5ba8-65", "ovs_interfaceid": "791d5ba8-656f-4176-bf36-d6aec3630a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:25:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f4efc643-9989-4bda-91c1-801a042aaef4 req-06c9a993-1b19-4b52-8df3-56b62bbf960b service nova] Releasing lock "refresh_cache-9be62b33-875c-490a-ab9f-a2e8451feac4" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'flavor' on Instance uuid 1cb42234-262e-4c9a-9b30-5315e07b5a42 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:00 user nova-compute[75026]: INFO nova.compute.manager [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Attaching volume 68f5bca1-2701-4e9d-9b9c-0163dc89d343 to /dev/vdb
Nov 10 19:26:00 user nova-compute[75026]: DEBUG os_brick.utils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd9e23a-dd55-45aa-a91d-bf3f7cbe3943]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c2cbb7-0ce5-4ab4-aad6-4f21febaa146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18673a89-a1d8-4d14-aa89-a77fc398c135]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4238b0-6eec-4110-af50-6922fe71cfac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:26:00 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:26:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb16c65-3aa6-4642-b2ea-2aa1b7ceb187]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG os_brick.utils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:26:00 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updating existing volume attachment record: 12c46d2e-e736-4919-9475-b04230afe302 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:26:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:01 user nova-compute[75026]: INFO nova.compute.manager [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Terminating instance
Nov 10 19:26:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-f3780168-638f-450b-bf1e-8652900d4990 req-87ee5aaa-42a7-4c0a-9a58-69f0bf3749c9 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3780168-638f-450b-bf1e-8652900d4990 req-87ee5aaa-42a7-4c0a-9a58-69f0bf3749c9 service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3780168-638f-450b-bf1e-8652900d4990 req-87ee5aaa-42a7-4c0a-9a58-69f0bf3749c9 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3780168-638f-450b-bf1e-8652900d4990 req-87ee5aaa-42a7-4c0a-9a58-69f0bf3749c9 service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-f3780168-638f-450b-bf1e-8652900d4990 req-87ee5aaa-42a7-4c0a-9a58-69f0bf3749c9 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-f3780168-638f-450b-bf1e-8652900d4990 req-87ee5aaa-42a7-4c0a-9a58-69f0bf3749c9 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-unplugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Instance destroyed successfully.
Nov 10 19:26:02 user nova-compute[75026]: DEBUG nova.objects.instance [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lazy-loading 'resources' on Instance uuid 01641144-84e2-49f1-9d09-6a15a9f42249 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-451439939',display_name='tempest-ServerActionsTestOtherB-server-451439939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-451439939',id=2,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvVkVWb9dVEqRuRuT2ffBvV3TJdc19vZNspMUpOGPmFGPm0LeJ4raIsH4SP4sKmapjhTOF3sS9s2wZtwnep91U/0WptQgdXdtQpDsiqbjkwhj63Sld1r5OgZdXtFQVTRA==',key_name='tempest-keypair-1985768914',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:23:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49d22011dbaa43728771bc3d1eefaa30',ramdisk_id='',reservation_id='r-b50l1eb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1354094982',owner_user_name='tempest-ServerActionsTestOtherB-1354094982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3955d2948c446c8b555fb7fea429581',uuid=01641144-84e2-49f1-9d09-6a15a9f42249,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converting VIF {"id": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "address": "fa:16:3e:17:eb:e2", "network": {"id": "ee6313e4-53cd-4708-b64a-e18c489b58b8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-548694425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49d22011dbaa43728771bc3d1eefaa30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacc7927d-74", "ovs_interfaceid": "acc7927d-7433-4d3b-a371-9b1433e46ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_vif [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacc7927d-74, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7eefdd02-2a3b-4b76-bd65-c057f11e3f4a) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:02 user nova-compute[75026]: INFO os_vif [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=acc7927d-7433-4d3b-a371-9b1433e46ee1,network=Network(ee6313e4-53cd-4708-b64a-e18c489b58b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacc7927d-74')
Nov 10 19:26:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymdNOxet', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:26:02 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19ce537-c700-4232-862b-5880ca7a5047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:26:02 user nova-compute[75026]: No targets found.
Nov 10 19:26:02 user nova-compute[75026]: iSNS:
Nov 10 19:26:02 user nova-compute[75026]: No targets found.
Nov 10 19:26:02 user nova-compute[75026]: STATIC:
Nov 10 19:26:02 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89
Nov 10 19:26:02 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:02 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:02 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765
Nov 10 19:26:02 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:02 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:02 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab
Nov 10 19:26:02 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:02 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:02 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8
Nov 10 19:26:02 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:02 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:02 user nova-compute[75026]: FIRMWARE:
Nov 10 19:26:02 user nova-compute[75026]: No targets found.
Nov 10 19:26:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:26:02 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:26:02 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[859845a6-5d8e-411c-b6e7-039f0c05cdfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66dd577-4136-4a06-94de-6d66a801b1e9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:26:02 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:26:02 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:26:02 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:26:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab (non-flash)
Nov 10 19:26:02 user nova-compute[75026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:26:02 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:26:02 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:26:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed982a7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a268f9-c793-467b-99c3-bfb06d78a446]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ae3b90-c461-442a-965c-4dcc329b1eac]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5b90de-95a9-456e-9393-7833027223ab]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8112ea0b-0870-45d2-8c73-6ff88ee53767]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35edec7-8cf9-415e-956d-da0080a4c9cd]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[693ef223-3c82-4aec-9c9a-2981c8135bb6]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260]
Nov 10 19:26:03 user nova-compute[75026]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab, portal: 172.16.0.220,3260] successful.
Nov 10 19:26:03 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edabbc8-72d7-4ed4-86c3-6bdd94fe92ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bed2c9-bb81-4b54-ab64-a7b857703644]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] <== disconnect_volume: return (286ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:26:03 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Deleting instance files /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249_del
Nov 10 19:26:03 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Deletion of /opt/stack/data/nova/instances/01641144-84e2-49f1-9d09-6a15a9f42249_del complete
Nov 10 19:26:03 user nova-compute[75026]: INFO nova.compute.manager [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 19:26:03 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:26:03 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Took 0.65 seconds to deallocate network for instance.
Nov 10 19:26:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-4f209244-5152-4889-9618-10fd158e63e0 req-2bba11b6-0a82-4fd4-9378-83ff4f1ebfa1 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-deleted-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:03 user nova-compute[75026]: INFO nova.compute.manager [req-4f209244-5152-4889-9618-10fd158e63e0 req-2bba11b6-0a82-4fd4-9378-83ff4f1ebfa1 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Neutron deleted interface acc7927d-7433-4d3b-a371-9b1433e46ee1; detaching it from the instance and deleting it from the info cache
Nov 10 19:26:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-4f209244-5152-4889-9618-10fd158e63e0 req-2bba11b6-0a82-4fd4-9378-83ff4f1ebfa1 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:26:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-4f209244-5152-4889-9618-10fd158e63e0 req-2bba11b6-0a82-4fd4-9378-83ff4f1ebfa1 service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Detach interface failed, port_id=acc7927d-7433-4d3b-a371-9b1433e46ee1, reason: Instance 01641144-84e2-49f1-9d09-6a15a9f42249 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:26:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-46d93407-18ad-4a15-bc22-0a0dd5462ab6 req-be29976f-456e-4f3d-8776-b9d81677722b service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-46d93407-18ad-4a15-bc22-0a0dd5462ab6 req-be29976f-456e-4f3d-8776-b9d81677722b service nova] Acquiring lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-46d93407-18ad-4a15-bc22-0a0dd5462ab6 req-be29976f-456e-4f3d-8776-b9d81677722b service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-46d93407-18ad-4a15-bc22-0a0dd5462ab6 req-be29976f-456e-4f3d-8776-b9d81677722b service nova] Lock "01641144-84e2-49f1-9d09-6a15a9f42249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-46d93407-18ad-4a15-bc22-0a0dd5462ab6 req-be29976f-456e-4f3d-8776-b9d81677722b service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] No waiting events found dispatching network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:04 user nova-compute[75026]: WARNING nova.compute.manager [req-46d93407-18ad-4a15-bc22-0a0dd5462ab6 req-be29976f-456e-4f3d-8776-b9d81677722b service nova] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Received unexpected event network-vif-plugged-acc7927d-7433-4d3b-a371-9b1433e46ee1 for instance with vm_state active and task_state deleting.
Nov 10 19:26:05 user nova-compute[75026]: INFO nova.compute.manager [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] [instance: 01641144-84e2-49f1-9d09-6a15a9f42249] Took 1.22 seconds to detach 1 volumes for instance.
Nov 10 19:26:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:05 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:26:05 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:26:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:05 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Deleted allocations for instance 01641144-84e2-49f1-9d09-6a15a9f42249
Nov 10 19:26:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-91396931-1a6e-41a5-92cc-bc970e498a22 tempest-ServerActionsTestOtherB-1354094982 tempest-ServerActionsTestOtherB-1354094982-project-member] Lock "01641144-84e2-49f1-9d09-6a15a9f42249" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.657s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG os_brick.utils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e099a025-0725-40ca-8e83-29c72b8466bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[293c2802-3330-43b8-83fe-42cfbad2ec37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9cae5-9770-4af1-8b6c-ee220b7213f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c66245-b711-4829-889b-aafb0bf25a62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:26:07 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2343b34-2aab-4289-858d-1e14e0f2d50c]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG os_brick.utils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Updating existing volume attachment record: a6399a7d-c4fe-4162-9b4d-32c31d82934e {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:26:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:26:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:26:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-f3f7d9f4-41ef-4804-a43e-0d23867d4598 req-2e38e495-2561-4238-a5a6-66b64a36ed1d service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-changed-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-f3f7d9f4-41ef-4804-a43e-0d23867d4598 req-2e38e495-2561-4238-a5a6-66b64a36ed1d service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing instance network info cache due to event network-changed-0ca08991-e4a7-472e-9b3b-fa8859848b3d. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3f7d9f4-41ef-4804-a43e-0d23867d4598 req-2e38e495-2561-4238-a5a6-66b64a36ed1d service nova] Acquiring lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3f7d9f4-41ef-4804-a43e-0d23867d4598 req-2e38e495-2561-4238-a5a6-66b64a36ed1d service nova] Acquired lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG nova.network.neutron [req-f3f7d9f4-41ef-4804-a43e-0d23867d4598 req-2e38e495-2561-4238-a5a6-66b64a36ed1d service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Refreshing network info cache for port 0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-f3f7d9f4-41ef-4804-a43e-0d23867d4598 req-2e38e495-2561-4238-a5a6-66b64a36ed1d service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updated VIF entry in instance network info cache for port 0ca08991-e4a7-472e-9b3b-fa8859848b3d. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-f3f7d9f4-41ef-4804-a43e-0d23867d4598 req-2e38e495-2561-4238-a5a6-66b64a36ed1d service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [{"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3f7d9f4-41ef-4804-a43e-0d23867d4598 req-2e38e495-2561-4238-a5a6-66b64a36ed1d service nova] Releasing lock "refresh_cache-c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:26:14 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:26:14 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:26:14 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7997MB free_disk=25.680004119873047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1cb42234-262e-4c9a-9b30-5315e07b5a42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f888a7cc-f582-4e5e-8e70-4fada2e30591 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4bca9e2c-c534-4714-995d-6c58970e7213 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9be62b33-875c-490a-ab9f-a2e8451feac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:26:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:16 user nova-compute[75026]: INFO nova.compute.manager [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Terminating instance
Nov 10 19:26:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-52c71de9-e1c9-4f53-9339-3ccfaf7889d8 req-66e6e681-8d15-4480-b48d-a1d7443439ea service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-52c71de9-e1c9-4f53-9339-3ccfaf7889d8 req-66e6e681-8d15-4480-b48d-a1d7443439ea service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-52c71de9-e1c9-4f53-9339-3ccfaf7889d8 req-66e6e681-8d15-4480-b48d-a1d7443439ea service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-52c71de9-e1c9-4f53-9339-3ccfaf7889d8 req-66e6e681-8d15-4480-b48d-a1d7443439ea service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-52c71de9-e1c9-4f53-9339-3ccfaf7889d8 req-66e6e681-8d15-4480-b48d-a1d7443439ea service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-unplugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-52c71de9-e1c9-4f53-9339-3ccfaf7889d8 req-66e6e681-8d15-4480-b48d-a1d7443439ea service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-a90d62b8-aaf9-4dd0-9d30-be24eb6c6f7f req-2fe51eab-4b8c-4ce6-a3a3-329293b49dfa service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a90d62b8-aaf9-4dd0-9d30-be24eb6c6f7f req-2fe51eab-4b8c-4ce6-a3a3-329293b49dfa service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a90d62b8-aaf9-4dd0-9d30-be24eb6c6f7f req-2fe51eab-4b8c-4ce6-a3a3-329293b49dfa service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a90d62b8-aaf9-4dd0-9d30-be24eb6c6f7f req-2fe51eab-4b8c-4ce6-a3a3-329293b49dfa service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-a90d62b8-aaf9-4dd0-9d30-be24eb6c6f7f req-2fe51eab-4b8c-4ce6-a3a3-329293b49dfa service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-unplugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-a90d62b8-aaf9-4dd0-9d30-be24eb6c6f7f req-2fe51eab-4b8c-4ce6-a3a3-329293b49dfa service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-a213664f-6914-471d-971f-3d221c380a08 req-d89ee841-feb2-4a32-8320-cf301cfa4057 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a213664f-6914-471d-971f-3d221c380a08 req-d89ee841-feb2-4a32-8320-cf301cfa4057 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a213664f-6914-471d-971f-3d221c380a08 req-d89ee841-feb2-4a32-8320-cf301cfa4057 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a213664f-6914-471d-971f-3d221c380a08 req-d89ee841-feb2-4a32-8320-cf301cfa4057 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-a213664f-6914-471d-971f-3d221c380a08 req-d89ee841-feb2-4a32-8320-cf301cfa4057 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-unplugged-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-a213664f-6914-471d-971f-3d221c380a08 req-d89ee841-feb2-4a32-8320-cf301cfa4057 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-8155e82e-493d-4bcc-918f-571aac53ecb1 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Instance destroyed successfully.
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.objects.instance [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lazy-loading 'resources' on Instance uuid c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "address": "fa:16:3e:2b:2e:69", "network": {"id": "b0e32b3b-3363-4242-8bcf-d8ad6ff14b37", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1898268110-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca08991-e4", "ovs_interfaceid": "0ca08991-e4a7-472e-9b3b-fa8859848b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2e:69,bridge_name='br-int',has_traffic_filtering=True,id=0ca08991-e4a7-472e-9b3b-fa8859848b3d,network=Network(b0e32b3b-3363-4242-8bcf-d8ad6ff14b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca08991-e4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2e:69,bridge_name='br-int',has_traffic_filtering=True,id=0ca08991-e4a7-472e-9b3b-fa8859848b3d,network=Network(b0e32b3b-3363-4242-8bcf-d8ad6ff14b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca08991-e4') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca08991-e4, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f95551e-5a0c-46ed-ae48-494548fabb21) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: INFO os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2e:69,bridge_name='br-int',has_traffic_filtering=True,id=0ca08991-e4a7-472e-9b3b-fa8859848b3d,network=Network(b0e32b3b-3363-4242-8bcf-d8ad6ff14b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca08991-e4')
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:91:55,bridge_name='br-int',has_traffic_filtering=True,id=532b429b-bd11-489f-a885-1c50ab94ca0e,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap532b429b-bd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:91:55,bridge_name='br-int',has_traffic_filtering=True,id=532b429b-bd11-489f-a885-1c50ab94ca0e,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap532b429b-bd') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap532b429b-bd, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37ad2ea7-df41-4529-a272-702723dcf7f7) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: INFO os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:91:55,bridge_name='br-int',has_traffic_filtering=True,id=532b429b-bd11-489f-a885-1c50ab94ca0e,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap532b429b-bd')
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:86:a5,bridge_name='br-int',has_traffic_filtering=True,id=21ba1689-92a0-4756-b441-d5c39fd32bf9,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21ba1689-92') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:86:a5,bridge_name='br-int',has_traffic_filtering=True,id=21ba1689-92a0-4756-b441-d5c39fd32bf9,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21ba1689-92') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21ba1689-92, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45017dc5-da87-42ba-8bec-49818756e05d) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: INFO os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:86:a5,bridge_name='br-int',has_traffic_filtering=True,id=21ba1689-92a0-4756-b441-d5c39fd32bf9,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21ba1689-92')
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:f6,bridge_name='br-int',has_traffic_filtering=True,id=8f6497a9-e4cf-46d2-a255-c55eabcc9531,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f6497a9-e4') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:f6,bridge_name='br-int',has_traffic_filtering=True,id=8f6497a9-e4cf-46d2-a255-c55eabcc9531,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f6497a9-e4') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f6497a9-e4, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26dc26a8-54e1-4389-b79d-b2e21f24fc20) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: INFO os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:48:f6,bridge_name='br-int',has_traffic_filtering=True,id=8f6497a9-e4cf-46d2-a255-c55eabcc9531,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f6497a9-e4')
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:28:e7,bridge_name='br-int',has_traffic_filtering=True,id=9f98a01d-0d0f-4457-a1ec-06649ad24312,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f98a01d-0d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:28:e7,bridge_name='br-int',has_traffic_filtering=True,id=9f98a01d-0d0f-4457-a1ec-06649ad24312,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f98a01d-0d') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f98a01d-0d, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=631ddb31-e674-48e8-a10d-0771401b1ba3) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: INFO os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:28:e7,bridge_name='br-int',has_traffic_filtering=True,id=9f98a01d-0d0f-4457-a1ec-06649ad24312,network=Network(ecc74dca-3480-4b4a-be50-0ddf49f6bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f98a01d-0d')
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7c:90,bridge_name='br-int',has_traffic_filtering=True,id=8155e82e-493d-4bcc-918f-571aac53ecb1,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8155e82e-49') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7c:90,bridge_name='br-int',has_traffic_filtering=True,id=8155e82e-493d-4bcc-918f-571aac53ecb1,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8155e82e-49') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8155e82e-49, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18a9f194-f73d-4ec3-88b9-5436b018be32) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: INFO os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7c:90,bridge_name='br-int',has_traffic_filtering=True,id=8155e82e-493d-4bcc-918f-571aac53ecb1,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8155e82e-49')
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T19:20:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1719862568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1719862568',id=14,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGirBSZc4WiknvWdHKK744XsbRJiNoutN9LbDwJ2uFVJ8fKzAwmPRNhcscAQua6Tbj8zRgHL/NJHDtw3ezUEcH0oB3tv7cGgCY7gSGYxzeDbbPvk3idNYIpcBPUH8N4rCg==',key_name='tempest-keypair-2019884959',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9addd4a21ed84ad9a226da278b948f73',ramdisk_id='',reservation_id='r-4cu114rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-607045118',owner_user_name='tempest-TaggedBootDevicesTest-607045118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ece2c4c22cf436083e053d9f2cf26db',uuid=c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converting VIF {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:31,bridge_name='br-int',has_traffic_filtering=True,id=37f75097-1500-400d-9ef4-68318d093eec,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f75097-15') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:31,bridge_name='br-int',has_traffic_filtering=True,id=37f75097-1500-400d-9ef4-68318d093eec,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f75097-15') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37f75097-15, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96135162-7800-4b3a-8aab-b7d61a4fa164) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:18 user nova-compute[75026]: INFO os_vif [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:31,bridge_name='br-int',has_traffic_filtering=True,id=37f75097-1500-400d-9ef4-68318d093eec,network=Network(f7a7af36-02c8-454c-aadf-544e3285f5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f75097-15')
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plhgHOQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:26:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee287b6-0a9d-48d1-8452-79196f7b4db9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:26:18 user nova-compute[75026]: No targets found.
Nov 10 19:26:18 user nova-compute[75026]: iSNS:
Nov 10 19:26:18 user nova-compute[75026]: No targets found.
Nov 10 19:26:18 user nova-compute[75026]: STATIC:
Nov 10 19:26:18 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89
Nov 10 19:26:18 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:18 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:18 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765
Nov 10 19:26:18 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:18 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:18 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8
Nov 10 19:26:18 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:18 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:18 user nova-compute[75026]: FIRMWARE:
Nov 10 19:26:18 user nova-compute[75026]: No targets found.
Nov 10 19:26:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:26:18 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:26:18 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f56d62-7994-4b54-a191-098acba59036]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2657806c-2649-4757-8aba-9c302c654883]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:26:18 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:26:18 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:26:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 (non-flash)
Nov 10 19:26:18 user nova-compute[75026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:26:18 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:26:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed8067e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8'): ({'sdd'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Removing single pathed devices sdd {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[949ea67d-59c3-4591-ac07-a10cf508006f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc10874-d9fd-44d4-88b1-fde80f6e43d6]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Flushing IO for device /dev/sdd {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbfab12-a9ce-46b3-ac98-fca4c298c43a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a45f94-1c6f-4a2b-89f5-db4adbda34a7]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aee924-5d49-4a11-bb6c-42c8b76fa626]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:18 user nova-compute[75026]: WARNING nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-0ca08991-e4a7-472e-9b3b-fa8859848b3d for instance with vm_state active and task_state deleting.
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-unplugged-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-532b429b-bd11-489f-a885-1c50ab94ca0e for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:18 user nova-compute[75026]: WARNING nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-532b429b-bd11-489f-a885-1c50ab94ca0e for instance with vm_state active and task_state deleting.
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-unplugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:18 user nova-compute[75026]: WARNING nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-21ba1689-92a0-4756-b441-d5c39fd32bf9 for instance with vm_state active and task_state deleting.
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-unplugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:18 user nova-compute[75026]: WARNING nova.compute.manager [req-1f459ea1-6b49-4462-95df-9ebaf6f477e4 req-6cbba13a-69d1-4768-9e1a-64a41e5a4b2f service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-9f98a01d-0d0f-4457-a1ec-06649ad24312 for instance with vm_state active and task_state deleting.
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64c2b06-5b32-4f14-95c7-1e96fddb2e74]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8, portal: 172.16.0.220,3260]
Nov 10 19:26:18 user nova-compute[75026]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8, portal: 172.16.0.220,3260] successful.
Nov 10 19:26:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5909e5b4-3695-4425-b3dd-9c6cb52328f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7137971d-1993-4842-9e42-936b951c5c0b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== disconnect_volume: return (304ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtIsmZik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:26:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:26:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fdcc21-6637-447d-bc99-3f2b877ae6aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:26:19 user nova-compute[75026]: No targets found.
Nov 10 19:26:19 user nova-compute[75026]: iSNS:
Nov 10 19:26:19 user nova-compute[75026]: No targets found.
Nov 10 19:26:19 user nova-compute[75026]: STATIC:
Nov 10 19:26:19 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89
Nov 10 19:26:19 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:19 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:19 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765
Nov 10 19:26:19 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:19 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:19 user nova-compute[75026]: FIRMWARE:
Nov 10 19:26:19 user nova-compute[75026]: No targets found.
Nov 10 19:26:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:26:19 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:26:19 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b137203-1ffd-4b56-ba91-7565b8429515]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd60e9e-ec00-48eb-be57-a778330cc999]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:26:19 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:26:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 (non-flash)
Nov 10 19:26:19 user nova-compute[75026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:26:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed8067e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89'): ({'sdf'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Removing single pathed devices sdf {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f886c7-ad3a-46da-99ed-277c5fa2d554]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f36b7b-8a0c-4553-8c6c-e4d495dfb330]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Flushing IO for device /dev/sdf {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0708e146-b58a-43d4-af37-e47d52a64c68]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d1276-197d-4ae1-a2d3-d97cd5a6fafb]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] SCSI volumes sdf have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[793f7064-c21e-4192-8300-8ca05c792a42]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e758d7d-add5-4b3d-a4e3-9cd423c58d3b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89, portal: 172.16.0.220,3260]
Nov 10 19:26:19 user nova-compute[75026]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89, portal: 172.16.0.220,3260] successful.
Nov 10 19:26:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:19 user nova-compute[75026]: WARNING nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-8f6497a9-e4cf-46d2-a255-c55eabcc9531 for instance with vm_state active and task_state deleting.
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-unplugged-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-unplugged-37f75097-1500-400d-9ef4-68318d093eec for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:19 user nova-compute[75026]: WARNING nova.compute.manager [req-09e6ece7-a7d9-4bfd-b31c-b8bfb32a324c req-330d4032-14c7-42e4-99ca-6252e7f0bc93 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-37f75097-1500-400d-9ef4-68318d093eec for instance with vm_state active and task_state deleting.
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a23eb6b9-10b2-4ff1-aac9-c12961105a89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f370e-65fd-42da-ab37-8eb97df18d61]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== disconnect_volume: return (293ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSCbAYze', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:26:19 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b7c189-1527-4e04-8c7b-731d17e9cfbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:26:19 user nova-compute[75026]: No targets found.
Nov 10 19:26:19 user nova-compute[75026]: iSNS:
Nov 10 19:26:19 user nova-compute[75026]: No targets found.
Nov 10 19:26:19 user nova-compute[75026]: STATIC:
Nov 10 19:26:19 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765
Nov 10 19:26:19 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:26:19 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:26:19 user nova-compute[75026]: FIRMWARE:
Nov 10 19:26:19 user nova-compute[75026]: No targets found.
Nov 10 19:26:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:26:19 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:26:19 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717247b-2a17-40f2-8520-429cc1744019]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a2983-aef2-45c5-afca-6f8ab03374d6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:26:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 (non-flash)
Nov 10 19:26:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda01adf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765'): ({'sdh'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Removing single pathed devices sdh {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aeae0a-a778-4711-8adc-4f8554b8da03]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd7cd00-fd9a-4346-933f-d88e15849102]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Flushing IO for device /dev/sdh {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a97ab4-235c-445c-a392-3faed69745af]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[29067254-4fe3-421a-beec-babb1c5eb5b4]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] SCSI volumes sdh have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d05da63-a2f0-42e2-b334-5ba76a294a14]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3349424-47a4-472c-b7a0-382d9f98eb54]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765, portal: 172.16.0.220,3260]
Nov 10 19:26:19 user nova-compute[75026]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765, portal: 172.16.0.220,3260] successful.
Nov 10 19:26:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b3f4033-c186-4a8c-ae63-2b2c914dc765 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad5e2d6-88b0-45ca-9a62-1b6e8d0278fd]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] <== disconnect_volume: return (313ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:26:19 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Deleting instance files /opt/stack/data/nova/instances/c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a_del
Nov 10 19:26:19 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Deletion of /opt/stack/data/nova/instances/c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a_del complete
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-dc4ddf67-94b4-417d-895e-c7e02b724093 req-32fad9be-c769-4814-93cf-575c86b0e986 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dc4ddf67-94b4-417d-895e-c7e02b724093 req-32fad9be-c769-4814-93cf-575c86b0e986 service nova] Acquiring lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dc4ddf67-94b4-417d-895e-c7e02b724093 req-32fad9be-c769-4814-93cf-575c86b0e986 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dc4ddf67-94b4-417d-895e-c7e02b724093 req-32fad9be-c769-4814-93cf-575c86b0e986 service nova] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-dc4ddf67-94b4-417d-895e-c7e02b724093 req-32fad9be-c769-4814-93cf-575c86b0e986 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] No waiting events found dispatching network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:26:19 user nova-compute[75026]: WARNING nova.compute.manager [req-dc4ddf67-94b4-417d-895e-c7e02b724093 req-32fad9be-c769-4814-93cf-575c86b0e986 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received unexpected event network-vif-plugged-8155e82e-493d-4bcc-918f-571aac53ecb1 for instance with vm_state active and task_state deleting.
Nov 10 19:26:19 user nova-compute[75026]: INFO nova.compute.manager [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Took 3.21 seconds to destroy the instance on the hypervisor.
Nov 10 19:26:19 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:26:19 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:26:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-e903aa83-0f43-4915-afd9-59f35e3598b8 req-39ff8c4b-de72-4d1b-9ba5-1122efc52bf6 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-deleted-0ca08991-e4a7-472e-9b3b-fa8859848b3d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:21 user nova-compute[75026]: INFO nova.compute.manager [req-e903aa83-0f43-4915-afd9-59f35e3598b8 req-39ff8c4b-de72-4d1b-9ba5-1122efc52bf6 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Neutron deleted interface 0ca08991-e4a7-472e-9b3b-fa8859848b3d; detaching it from the instance and deleting it from the info cache
Nov 10 19:26:21 user nova-compute[75026]: DEBUG nova.network.neutron [req-e903aa83-0f43-4915-afd9-59f35e3598b8 req-39ff8c4b-de72-4d1b-9ba5-1122efc52bf6 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [{"id": "532b429b-bd11-489f-a885-1c50ab94ca0e", "address": "fa:16:3e:a9:91:55", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b429b-bd", "ovs_interfaceid": "532b429b-bd11-489f-a885-1c50ab94ca0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "address": "fa:16:3e:e8:86:a5", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ba1689-92", "ovs_interfaceid": "21ba1689-92a0-4756-b441-d5c39fd32bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "address": "fa:16:3e:72:48:f6", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f6497a9-e4", "ovs_interfaceid": "8f6497a9-e4cf-46d2-a255-c55eabcc9531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "address": "fa:16:3e:c0:28:e7", "network": {"id": "ecc74dca-3480-4b4a-be50-0ddf49f6bb1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-253290740", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f98a01d-0d", "ovs_interfaceid": "9f98a01d-0d0f-4457-a1ec-06649ad24312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8155e82e-493d-4bcc-918f-571aac53ecb1", "address": "fa:16:3e:e7:7c:90", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8155e82e-49", "ovs_interfaceid": "8155e82e-493d-4bcc-918f-571aac53ecb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37f75097-1500-400d-9ef4-68318d093eec", "address": "fa:16:3e:bf:29:31", "network": {"id": "f7a7af36-02c8-454c-aadf-544e3285f5c6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1495721170", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9addd4a21ed84ad9a226da278b948f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f75097-15", "ovs_interfaceid": "37f75097-1500-400d-9ef4-68318d093eec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:26:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-e903aa83-0f43-4915-afd9-59f35e3598b8 req-39ff8c4b-de72-4d1b-9ba5-1122efc52bf6 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Detach interface failed, port_id=0ca08991-e4a7-472e-9b3b-fa8859848b3d, reason: Instance c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:26:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:23 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:26:23 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Took 3.59 seconds to deallocate network for instance.
Nov 10 19:26:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-4af26005-bfdf-4a7f-b91c-0c0357c04db9 req-44310334-3a5f-4598-b0fa-d363c9c5f062 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-deleted-37f75097-1500-400d-9ef4-68318d093eec {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-4af26005-bfdf-4a7f-b91c-0c0357c04db9 req-44310334-3a5f-4598-b0fa-d363c9c5f062 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-deleted-8155e82e-493d-4bcc-918f-571aac53ecb1 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-4af26005-bfdf-4a7f-b91c-0c0357c04db9 req-44310334-3a5f-4598-b0fa-d363c9c5f062 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-deleted-8f6497a9-e4cf-46d2-a255-c55eabcc9531 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-4af26005-bfdf-4a7f-b91c-0c0357c04db9 req-44310334-3a5f-4598-b0fa-d363c9c5f062 service nova] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Received event network-vif-deleted-9f98a01d-0d0f-4457-a1ec-06649ad24312 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.volume.cinder [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Update attachment failed for attachment a6399a7d-c4fe-4162-9b4d-32c31d82934e. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35e4ce06-fc27-4aec-84a2-16fd66513297) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35e4ce06-fc27-4aec-84a2-16fd66513297)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35e4ce06-fc27-4aec-84a2-16fd66513297)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Traceback (most recent call last):
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     driver_block_device.attach_block_devices(
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     _log_and_attach(device)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/virt/block_device.py", line 819, in attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     super(DriverVolSnapshotBlockDevice, self).attach(
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     self._do_attach(context, instance, volume, volume_api,
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     self._volume_attach(context, volume, connector, instance,
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     connection_info = volume_api.attachment_update(
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     res = method(self, ctx, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     with excutils.save_and_reraise_exception():
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     self.force_reraise()
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     raise self.value
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     return method.func(obj, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     resp = self._update('/attachments/%s' % id, body)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     return self.request(url, method, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4]     raise exceptions.from_response(resp, body)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35e4ce06-fc27-4aec-84a2-16fd66513297)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] 
Nov 10 19:26:25 user nova-compute[75026]: DEBUG nova.compute.claims [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Aborting claim: <nova.compute.claims.Claim object at 0x7feda0f978b0> {{(pid=75026) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 19:26:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.volume.cinder [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Update attachment failed for attachment 12c46d2e-e736-4919-9475-b04230afe302. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-29a36512-69c0-42c1-894b-df8ae5237408) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-29a36512-69c0-42c1-894b-df8ae5237408)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Failed to attach 68f5bca1-2701-4e9d-9b9c-0163dc89d343 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-29a36512-69c0-42c1-894b-df8ae5237408)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Traceback (most recent call last):
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     self._do_attach(context, instance, volume, volume_api,
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     self._volume_attach(context, volume, connector, instance,
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     connection_info = volume_api.attachment_update(
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     res = method(self, ctx, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     with excutils.save_and_reraise_exception():
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     self.force_reraise()
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     raise self.value
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     return method.func(obj, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     resp = self._update('/attachments/%s' % id, body)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     return self.request(url, method, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42]     raise exceptions.from_response(resp, body)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-29a36512-69c0-42c1-894b-df8ae5237408)
Nov 10 19:26:25 user nova-compute[75026]: ERROR nova.compute.manager [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] 
Nov 10 19:26:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.413s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server [None req-1afcfcc4-3af2-414f-8a84-f28bd37df6fb tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-29a36512-69c0-42c1-894b-df8ae5237408)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-29a36512-69c0-42c1-894b-df8ae5237408)
Nov 10 19:26:25 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.335s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Build of instance 9be62b33-875c-490a-ab9f-a2e8451feac4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35e4ce06-fc27-4aec-84a2-16fd66513297) {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.utils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Build of instance 9be62b33-875c-490a-ab9f-a2e8451feac4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75026) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 19:26:26 user nova-compute[75026]: ERROR nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Build of instance 9be62b33-875c-490a-ab9f-a2e8451feac4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35e4ce06-fc27-4aec-84a2-16fd66513297): nova.exception.BuildAbortException: Build of instance 9be62b33-875c-490a-ab9f-a2e8451feac4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35e4ce06-fc27-4aec-84a2-16fd66513297)
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Unplugging VIFs for instance {{(pid=75026) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1425801997',display_name='tempest-TestVolumeBootPattern-server-1425801997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1425801997',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-8j3vk9o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:25:56Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=9be62b33-875c-490a-ab9f-a2e8451feac4,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "791d5ba8-656f-4176-bf36-d6aec3630a46", "address": "fa:16:3e:87:6a:ec", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791d5ba8-65", "ovs_interfaceid": "791d5ba8-656f-4176-bf36-d6aec3630a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "791d5ba8-656f-4176-bf36-d6aec3630a46", "address": "fa:16:3e:87:6a:ec", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791d5ba8-65", "ovs_interfaceid": "791d5ba8-656f-4176-bf36-d6aec3630a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=791d5ba8-656f-4176-bf36-d6aec3630a46,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791d5ba8-65') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG os_vif [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=791d5ba8-656f-4176-bf36-d6aec3630a46,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791d5ba8-65') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap791d5ba8-65, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:26:26 user nova-compute[75026]: INFO os_vif [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=791d5ba8-656f-4176-bf36-d6aec3630a46,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791d5ba8-65')
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Unplugged VIFs for instance {{(pid=75026) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:26:26 user nova-compute[75026]: INFO nova.compute.manager [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] [instance: c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a] Took 3.03 seconds to detach 3 volumes for instance.
Nov 10 19:26:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:26:26 user nova-compute[75026]: INFO nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Took 0.52 seconds to deallocate network for instance.
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Detaching volume: a5474322-08ba-4bd7-af3e-28c722a857ee {{(pid=75026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 19:26:26 user nova-compute[75026]: INFO nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Detaching volume a5474322-08ba-4bd7-af3e-28c722a857ee
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:26 user nova-compute[75026]: ERROR nova.virt.block_device [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Unable to call for a driver detach of volume a5474322-08ba-4bd7-af3e-28c722a857ee due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 9be62b33-875c-490a-ab9f-a2e8451feac4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-35e4ce06-fc27-4aec-84a2-16fd66513297)
Nov 10 19:26:26 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Deleted allocations for instance c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a
Nov 10 19:26:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7ba4f937-ef9c-430a-80a8-c5e552aa0591 tempest-TaggedBootDevicesTest-607045118 tempest-TaggedBootDevicesTest-607045118-project-member] Lock "c95352ed-b209-4f4a-9aa2-0f5ac64a3e3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.399s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 9be62b33-875c-490a-ab9f-a2e8451feac4] Deleting volume: a5474322-08ba-4bd7-af3e-28c722a857ee {{(pid=75026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 19:26:27 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Deleted allocations for instance 9be62b33-875c-490a-ab9f-a2e8451feac4
Nov 10 19:26:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0d868971-83f0-43b3-91ee-f1a99a937e9f tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "9be62b33-875c-490a-ab9f-a2e8451feac4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.160s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-74425015-1e37-4d9f-87ea-0dc94e13718e req-4bda8544-9f7e-4a40-81aa-90a8183f584c service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received event network-changed-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:26:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-74425015-1e37-4d9f-87ea-0dc94e13718e req-4bda8544-9f7e-4a40-81aa-90a8183f584c service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Refreshing instance network info cache due to event network-changed-dd88a6d2-cac6-453c-bddd-074cdf43f560. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:26:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-74425015-1e37-4d9f-87ea-0dc94e13718e req-4bda8544-9f7e-4a40-81aa-90a8183f584c service nova] Acquiring lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:26:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-74425015-1e37-4d9f-87ea-0dc94e13718e req-4bda8544-9f7e-4a40-81aa-90a8183f584c service nova] Acquired lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:26:41 user nova-compute[75026]: DEBUG nova.network.neutron [req-74425015-1e37-4d9f-87ea-0dc94e13718e req-4bda8544-9f7e-4a40-81aa-90a8183f584c service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Refreshing network info cache for port dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:26:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:41 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'flavor' on Instance uuid f888a7cc-f582-4e5e-8e70-4fada2e30591 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:26:41 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Ignoring supplied device name: /dev/vdb
Nov 10 19:26:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:26:42 user nova-compute[75026]: INFO nova.compute.manager [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Attaching volume ddea0b8f-7b86-4d04-bfda-675a0262d97a to /dev/vdb
Nov 10 19:26:42 user nova-compute[75026]: DEBUG os_brick.utils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c986337d-69eb-4f1a-a0e0-edad13804eba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[269448dc-6243-41aa-96fe-e2d37e59d299]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac94b6-4029-4924-8510-73c14a10b916]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7dd50b-93ac-4bd9-989a-5153fdf5610b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:26:42 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2f723-3415-4966-9f9e-e1af547ce952]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG os_brick.utils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updating existing volume attachment record: 50344f02-43ae-446e-8ab1-c79d5e35b98e {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-74425015-1e37-4d9f-87ea-0dc94e13718e req-4bda8544-9f7e-4a40-81aa-90a8183f584c service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updated VIF entry in instance network info cache for port dd88a6d2-cac6-453c-bddd-074cdf43f560. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-74425015-1e37-4d9f-87ea-0dc94e13718e req-4bda8544-9f7e-4a40-81aa-90a8183f584c service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updating instance_info_cache with network_info: [{"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:26:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-74425015-1e37-4d9f-87ea-0dc94e13718e req-4bda8544-9f7e-4a40-81aa-90a8183f584c service nova] Releasing lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:26:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:26:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "4bca9e2c-c534-4714-995d-6c58970e7213" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "4bca9e2c-c534-4714-995d-6c58970e7213" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:06 user nova-compute[75026]: INFO nova.compute.manager [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Terminating instance
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-cc292d1e-a79f-453d-bd21-ce71865c9c29 req-746fb877-af14-4fb4-af43-0137f8eb6397 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received event network-vif-unplugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cc292d1e-a79f-453d-bd21-ce71865c9c29 req-746fb877-af14-4fb4-af43-0137f8eb6397 service nova] Acquiring lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cc292d1e-a79f-453d-bd21-ce71865c9c29 req-746fb877-af14-4fb4-af43-0137f8eb6397 service nova] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cc292d1e-a79f-453d-bd21-ce71865c9c29 req-746fb877-af14-4fb4-af43-0137f8eb6397 service nova] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-cc292d1e-a79f-453d-bd21-ce71865c9c29 req-746fb877-af14-4fb4-af43-0137f8eb6397 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] No waiting events found dispatching network-vif-unplugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-cc292d1e-a79f-453d-bd21-ce71865c9c29 req-746fb877-af14-4fb4-af43-0137f8eb6397 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received event network-vif-unplugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:27:06 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Instance destroyed successfully.
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lazy-loading 'resources' on Instance uuid 4bca9e2c-c534-4714-995d-6c58970e7213 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-30167434',display_name='tempest-VolumesActionsTest-instance-30167434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-30167434',id=18,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:25:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db33bf19db0840e9b7c5380e5e4ded1e',ramdisk_id='',reservation_id='r-j8gg0o8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1781528389',owner_user_name='tempest-VolumesActionsTest-1781528389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:25:01Z,user_data=None,user_id='b959bd7e72f94aeea99e8768167dd00d',uuid=4bca9e2c-c534-4714-995d-6c58970e7213,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Converting VIF {"id": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "address": "fa:16:3e:51:88:be", "network": {"id": "26c39e6e-878c-4ac1-80b1-e1723b02cb87", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1797982902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db33bf19db0840e9b7c5380e5e4ded1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d693eb-ff", "ovs_interfaceid": "42d693eb-ffff-48ee-80c1-c4c29bcb5945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:88:be,bridge_name='br-int',has_traffic_filtering=True,id=42d693eb-ffff-48ee-80c1-c4c29bcb5945,network=Network(26c39e6e-878c-4ac1-80b1-e1723b02cb87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d693eb-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG os_vif [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:88:be,bridge_name='br-int',has_traffic_filtering=True,id=42d693eb-ffff-48ee-80c1-c4c29bcb5945,network=Network(26c39e6e-878c-4ac1-80b1-e1723b02cb87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d693eb-ff') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42d693eb-ff, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=809c739a-81cb-456b-ab99-fe809afd2a48) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:27:06 user nova-compute[75026]: INFO os_vif [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:88:be,bridge_name='br-int',has_traffic_filtering=True,id=42d693eb-ffff-48ee-80c1-c4c29bcb5945,network=Network(26c39e6e-878c-4ac1-80b1-e1723b02cb87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d693eb-ff')
Nov 10 19:27:06 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Deleting instance files /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213_del
Nov 10 19:27:06 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Deletion of /opt/stack/data/nova/instances/4bca9e2c-c534-4714-995d-6c58970e7213_del complete
Nov 10 19:27:06 user nova-compute[75026]: INFO nova.compute.manager [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 10 19:27:06 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:27:06 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:27:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:07 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:27:07 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Took 0.58 seconds to deallocate network for instance.
Nov 10 19:27:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-93863ef0-e46e-4b05-8649-b4793b22a2a8 req-33d84281-de92-4ddf-8141-66991354ebd9 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received event network-vif-deleted-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:27:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:07 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:27:07 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:27:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:08 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Deleted allocations for instance 4bca9e2c-c534-4714-995d-6c58970e7213
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5c91fde7-8c3a-4f70-b1cd-9ce5228c4031 tempest-VolumesActionsTest-1781528389 tempest-VolumesActionsTest-1781528389-project-member] Lock "4bca9e2c-c534-4714-995d-6c58970e7213" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNqgwmGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:27:08 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:27:08 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:27:08 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[851ec27a-d1ea-4902-8395-0a91be365f0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:27:08 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb35b3-65ac-4442-bd71-7111fbe8d79e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a] added
Nov 10 19:27:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4265035d-92fb-4f88-b340-057c6b35ad63]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df0528c-55ca-4676-aa91-21e8f309c3cc]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNqgwmGn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNqgwmGn" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a382cc0-8dd6-4311-b3ce-2fc22fda0ff0]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jNqgwmGn'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aa2354-f93e-4fbb-b14e-8c4852c832ea]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d8eb4-8f41-4e70-a405-a67e76ef7c58]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:27:08 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:27:08 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:27:08 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:27:08 user nova-compute[75026]: 
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-526d693c-74fa-4db0-be52-5186e1b9fbba req-d06ef71c-1278-4266-8f11-be0a067266f4 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received event network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-526d693c-74fa-4db0-be52-5186e1b9fbba req-d06ef71c-1278-4266-8f11-be0a067266f4 service nova] Acquiring lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-526d693c-74fa-4db0-be52-5186e1b9fbba req-d06ef71c-1278-4266-8f11-be0a067266f4 service nova] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-526d693c-74fa-4db0-be52-5186e1b9fbba req-d06ef71c-1278-4266-8f11-be0a067266f4 service nova] Lock "4bca9e2c-c534-4714-995d-6c58970e7213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-526d693c-74fa-4db0-be52-5186e1b9fbba req-d06ef71c-1278-4266-8f11-be0a067266f4 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] No waiting events found dispatching network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:27:08 user nova-compute[75026]: WARNING nova.compute.manager [req-526d693c-74fa-4db0-be52-5186e1b9fbba req-d06ef71c-1278-4266-8f11-be0a067266f4 service nova] [instance: 4bca9e2c-c534-4714-995d-6c58970e7213] Received unexpected event network-vif-plugged-42d693eb-ffff-48ee-80c1-c4c29bcb5945 for instance with vm_state deleted and task_state None.
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[540b4fb3-680d-4c99-924e-389faa81a335]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a, portal: 172.16.0.220,3260]
Nov 10 19:27:08 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a, portal: 172.16.0.220,3260] successful.
Nov 10 19:27:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[219577db-1295-4924-80ae-7985d42f24ef]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[682d5f93-3e88-4111-8185-b08b0188aa03]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:27:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:27:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2956532-a6a3-450c-9778-c5a84d0eda27]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNqgwmGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:27:08 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 1cb42234-262e-4c9a-9b30-5315e07b5a42 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23436366563313066', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436366563313066', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'flavor' on Instance uuid f888a7cc-f582-4e5e-8e70-4fada2e30591 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updating instance_info_cache with network_info: [{"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:27:09 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:27:09 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:27:09 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:27:09 user nova-compute[75026]:   <serial>ddea0b8f-7b86-4d04-bfda-675a0262d97a</serial>
Nov 10 19:27:09 user nova-compute[75026]: </disk>
Nov 10 19:27:09 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-1cb42234-262e-4c9a-9b30-5315e07b5a42" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:27:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:27:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No VIF found with MAC fa:16:3e:65:80:f9, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:27:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea227817-9d0c-4703-9181-0c3bdb19e3ac tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.287s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:13 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:13 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:27:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:14 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:27:15 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:27:15 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:27:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8378MB free_disk=25.694244384765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:27:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0c42552f-3882-4f34-bf6a-fdef6a69e785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1cb42234-262e-4c9a-9b30-5315e07b5a42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f888a7cc-f582-4e5e-8e70-4fada2e30591 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:17 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:27:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:27:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:27:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:22 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:27:22 user nova-compute[75026]: INFO nova.compute.manager [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] instance snapshotting
Nov 10 19:27:22 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Beginning live snapshot process
Nov 10 19:27:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json -f qcow2 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json -f qcow2 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphj9y97tf/129a931a0d6d491daaab4e47e3533137.delta 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphj9y97tf/129a931a0d6d491daaab4e47e3533137.delta 1073741824" returned: 0 in 0.065s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 19:27:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:27:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:27:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 19:27:24 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:27:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphj9y97tf/129a931a0d6d491daaab4e47e3533137.delta /opt/stack/data/nova/instances/snapshots/tmphj9y97tf/129a931a0d6d491daaab4e47e3533137 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphj9y97tf/129a931a0d6d491daaab4e47e3533137.delta /opt/stack/data/nova/instances/snapshots/tmphj9y97tf/129a931a0d6d491daaab4e47e3533137" returned: 0 in 0.771s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Snapshot extracted, beginning image upload
Nov 10 19:27:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:29 user nova-compute[75026]: INFO nova.compute.manager [None req-0041d6f7-585b-49cf-af81-203457756362 tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Get console output
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:29 user nova-compute[75026]: INFO nova.compute.manager [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Terminating instance
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] During wait destroy, instance disappeared. {{(pid=75026) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 10 19:27:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Instance destroyed successfully.
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lazy-loading 'resources' on Instance uuid 0c42552f-3882-4f34-bf6a-fdef6a69e785 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1631229507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-162507539',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRD8myHOfIhviu7LfFnBihpO63lRGsWq1HpX5chid9pgfh39F9om3fOpUOeK796Dxjla897sHiGYLDgEOk7pyFgQBoCBBrE5hhw1iV8IbOeo2vVmNrw0cMSi8cUNDQ1OA==',key_name='tempest-keypair-528756599',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:18:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='9c4d825c26084145af53ad27bb9ebcec',ramdisk_id='',reservation_id='r-g0r0xvj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2124583126',owner_user_name='tempest-ServerActionsV293TestJSON-2124583126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e249c4693e7f4301b7ee850a0a2a3e45',uuid=0c42552f-3882-4f34-bf6a-fdef6a69e785,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Converting VIF {"id": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "address": "fa:16:3e:0a:db:aa", "network": {"id": "38dbcf8c-87e7-4334-84fc-0c3dfc4243b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1583824372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c4d825c26084145af53ad27bb9ebcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d4b1476-7a", "ovs_interfaceid": "4d4b1476-7a64-4370-aa6c-71afdb5ca843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_vif [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d4b1476-7a, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:27:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Snapshot image upload complete
Nov 10 19:27:29 user nova-compute[75026]: INFO nova.compute.manager [None req-e6ba010f-aeeb-4703-ae40-209cbf02e86b tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Took 6.95 seconds to snapshot the instance on the hypervisor.
Nov 10 19:27:29 user nova-compute[75026]: INFO os_vif [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:db:aa,bridge_name='br-int',has_traffic_filtering=True,id=4d4b1476-7a64-4370-aa6c-71afdb5ca843,network=Network(38dbcf8c-87e7-4334-84fc-0c3dfc4243b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d4b1476-7a')
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUfquvom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:27:29 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de03b6d-d38b-4973-9480-a67695bdbabe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:27:29 user nova-compute[75026]: No targets found.
Nov 10 19:27:29 user nova-compute[75026]: iSNS:
Nov 10 19:27:29 user nova-compute[75026]: No targets found.
Nov 10 19:27:29 user nova-compute[75026]: STATIC:
Nov 10 19:27:29 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a
Nov 10 19:27:29 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:27:29 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:27:29 user nova-compute[75026]: FIRMWARE:
Nov 10 19:27:29 user nova-compute[75026]: No targets found.
Nov 10 19:27:29 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:27:29 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:27:29 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:277e5d4b-3d2c-487d-9525-c2152138cb88', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8bb0f-d333-4424-96d1-3058d5ba41bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca8003-35db-4423-bb5c-a902b81e9f19]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:27:29 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:27:29 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed8067e7a0>, {}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Disconnecting from: [] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] <== disconnect_volume: return (90ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:27:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Deletion of /opt/stack/data/nova/instances/0c42552f-3882-4f34-bf6a-fdef6a69e785_del complete
Nov 10 19:27:29 user nova-compute[75026]: INFO nova.compute.manager [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Took 0.30 seconds to destroy the instance on the hypervisor.
Nov 10 19:27:29 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:27:29 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:27:30 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:27:30 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Took 1.24 seconds to deallocate network for instance.
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-90b81f79-4739-4c8c-8694-968b120bbf86 req-af84e06c-191a-4928-b765-3b159d6ae877 service nova] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Received event network-vif-deleted-4d4b1476-7a64-4370-aa6c-71afdb5ca843 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:27:31 user nova-compute[75026]: INFO nova.compute.manager [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Took 0.11 seconds to detach 1 volumes for instance.
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] [instance: 0c42552f-3882-4f34-bf6a-fdef6a69e785] Deleting volume: 277e5d4b-3d2c-487d-9525-c2152138cb88 {{(pid=75026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 2316-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:31 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Deleted allocations for instance 0c42552f-3882-4f34-bf6a-fdef6a69e785
Nov 10 19:27:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d1487ff-5e7f-4398-be0a-79428cdbf52b tempest-ServerActionsV293TestJSON-2124583126 tempest-ServerActionsV293TestJSON-2124583126-project-member] Lock "0c42552f-3882-4f34-bf6a-fdef6a69e785" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.681s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:27:38 user nova-compute[75026]: INFO nova.compute.claims [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Claim successful on node user
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:27:38 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.policy [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4fcc097fff34ad2b2cc532d269e06bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdef98b8144148229b82888b888d88c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "00fbb0b3-a888-4348-ad97-41aed258ff13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:27:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Creating image(s)
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "/opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "/opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:27:39 user nova-compute[75026]: INFO nova.compute.claims [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Claim successful on node user
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.205s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.208s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk 1073741824" returned: 0 in 0.054s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Successfully created port: b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:27:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.197s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:39 user nova-compute[75026]: DEBUG nova.policy [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '758478b59f94467898696fa7af7cd630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e509e662d27146fba4f51fd55dbe6f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:27:39 user nova-compute[75026]: INFO nova.virt.block_device [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Booting with volume f64ea220-d986-439c-8954-61477fe1244b at /dev/vda
Nov 10 19:27:40 user nova-compute[75026]: DEBUG os_brick.utils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Cannot resize image /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Ensure instance console log exists: /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab35892-b464-431a-98b5-0931cad4d180]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac543d-ad83-4537-afec-b835b6655636]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fa4807-a1dc-4b7b-b9df-81c1164c78ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[23214558-3b46-4892-be36-21cfeb7d1706]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:27:40 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:27:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeaa219-1ea3-4a2c-88b4-d74cf7862399]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG os_brick.utils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Updating existing volume attachment record: c9596e69-96ad-47f7-9488-0dc82ec99128 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:27:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Successfully created port: e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Successfully updated port: b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquired lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-196632e1-866c-46bc-a172-8c60e509d597 req-40c9db86-03de-423f-aafa-e562764a446d service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-changed-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-196632e1-866c-46bc-a172-8c60e509d597 req-40c9db86-03de-423f-aafa-e562764a446d service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Refreshing instance network info cache due to event network-changed-b2b60a7f-6664-4ecd-8cf6-c4803546ee32. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-196632e1-866c-46bc-a172-8c60e509d597 req-40c9db86-03de-423f-aafa-e562764a446d service nova] Acquiring lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Releasing lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Instance network_info: |[{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-196632e1-866c-46bc-a172-8c60e509d597 req-40c9db86-03de-423f-aafa-e562764a446d service nova] Acquired lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.network.neutron [req-196632e1-866c-46bc-a172-8c60e509d597 req-40c9db86-03de-423f-aafa-e562764a446d service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Refreshing network info cache for port b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Start _get_guest_xml network_info=[{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:27:41 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:27:41 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-330240232',display_name='tempest-ServerActionsTestOtherA-server-330240232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-330240232',id=21,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-ixbl3asz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=9bcd68f9-db0e-4dd0-a831-c985e575ff9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8c:86,bridge_name='br-int',has_traffic_filtering=True,id=b2b60a7f-6664-4ecd-8cf6-c4803546ee32,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b60a7f-66') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:27:41 user nova-compute[75026]: DEBUG nova.objects.instance [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bcd68f9-db0e-4dd0-a831-c985e575ff9e {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:27:42 user nova-compute[75026]:   <uuid>9bcd68f9-db0e-4dd0-a831-c985e575ff9e</uuid>
Nov 10 19:27:42 user nova-compute[75026]:   <name>instance-00000015</name>
Nov 10 19:27:42 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:27:42 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:27:42 user nova-compute[75026]:   <metadata>
Nov 10 19:27:42 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:27:42 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:27:42 user nova-compute[75026]:       <nova:name>tempest-ServerActionsTestOtherA-server-330240232</nova:name>
Nov 10 19:27:42 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:27:41</nova:creationTime>
Nov 10 19:27:42 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:27:42 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:27:42 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:27:42 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:27:42 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:27:42 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:27:42 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:27:42 user nova-compute[75026]:       <nova:owner>
Nov 10 19:27:42 user nova-compute[75026]:         <nova:user uuid="b4fcc097fff34ad2b2cc532d269e06bb">tempest-ServerActionsTestOtherA-664805234-project-member</nova:user>
Nov 10 19:27:42 user nova-compute[75026]:         <nova:project uuid="cdef98b8144148229b82888b888d88c5">tempest-ServerActionsTestOtherA-664805234</nova:project>
Nov 10 19:27:42 user nova-compute[75026]:       </nova:owner>
Nov 10 19:27:42 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:27:42 user nova-compute[75026]:       <nova:ports>
Nov 10 19:27:42 user nova-compute[75026]:         <nova:port uuid="b2b60a7f-6664-4ecd-8cf6-c4803546ee32">
Nov 10 19:27:42 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 19:27:42 user nova-compute[75026]:         </nova:port>
Nov 10 19:27:42 user nova-compute[75026]:       </nova:ports>
Nov 10 19:27:42 user nova-compute[75026]:     </nova:instance>
Nov 10 19:27:42 user nova-compute[75026]:   </metadata>
Nov 10 19:27:42 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:27:42 user nova-compute[75026]:     <system>
Nov 10 19:27:42 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:27:42 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:27:42 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:27:42 user nova-compute[75026]:       <entry name="serial">9bcd68f9-db0e-4dd0-a831-c985e575ff9e</entry>
Nov 10 19:27:42 user nova-compute[75026]:       <entry name="uuid">9bcd68f9-db0e-4dd0-a831-c985e575ff9e</entry>
Nov 10 19:27:42 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:27:42 user nova-compute[75026]:     </system>
Nov 10 19:27:42 user nova-compute[75026]:   </sysinfo>
Nov 10 19:27:42 user nova-compute[75026]:   <os>
Nov 10 19:27:42 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:27:42 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:27:42 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:27:42 user nova-compute[75026]:   </os>
Nov 10 19:27:42 user nova-compute[75026]:   <features>
Nov 10 19:27:42 user nova-compute[75026]:     <acpi/>
Nov 10 19:27:42 user nova-compute[75026]:     <apic/>
Nov 10 19:27:42 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:27:42 user nova-compute[75026]:   </features>
Nov 10 19:27:42 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:27:42 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:27:42 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:27:42 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:27:42 user nova-compute[75026]:   </clock>
Nov 10 19:27:42 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:27:42 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:27:42 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:27:42 user nova-compute[75026]:   </cpu>
Nov 10 19:27:42 user nova-compute[75026]:   <devices>
Nov 10 19:27:42 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:27:42 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:27:42 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk"/>
Nov 10 19:27:42 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:27:42 user nova-compute[75026]:     </disk>
Nov 10 19:27:42 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:27:42 user nova-compute[75026]:       <mac address="fa:16:3e:89:8c:86"/>
Nov 10 19:27:42 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:27:42 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:27:42 user nova-compute[75026]:       <target dev="tapb2b60a7f-66"/>
Nov 10 19:27:42 user nova-compute[75026]:     </interface>
Nov 10 19:27:42 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:27:42 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/console.log" append="off"/>
Nov 10 19:27:42 user nova-compute[75026]:     </serial>
Nov 10 19:27:42 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:27:42 user nova-compute[75026]:     <video>
Nov 10 19:27:42 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:27:42 user nova-compute[75026]:     </video>
Nov 10 19:27:42 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:27:42 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:27:42 user nova-compute[75026]:     </rng>
Nov 10 19:27:42 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:27:42 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:27:42 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:27:42 user nova-compute[75026]:     </memballoon>
Nov 10 19:27:42 user nova-compute[75026]:   </devices>
Nov 10 19:27:42 user nova-compute[75026]: </domain>
Nov 10 19:27:42 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-330240232',display_name='tempest-ServerActionsTestOtherA-server-330240232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-330240232',id=21,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-ixbl3asz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=9bcd68f9-db0e-4dd0-a831-c985e575ff9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8c:86,bridge_name='br-int',has_traffic_filtering=True,id=b2b60a7f-6664-4ecd-8cf6-c4803546ee32,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b60a7f-66') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG os_vif [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8c:86,bridge_name='br-int',has_traffic_filtering=True,id=b2b60a7f-6664-4ecd-8cf6-c4803546ee32,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b60a7f-66') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ad6a956-b1aa-5a0e-af52-433cbcacb12f', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2b60a7f-66, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2b60a7f-66, col_values=(('qos', UUID('b47f8429-b8c3-44e0-b13f-02f5e1891cc8')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2b60a7f-66, col_values=(('external_ids', {'iface-id': 'b2b60a7f-6664-4ecd-8cf6-c4803546ee32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:8c:86', 'vm-uuid': '9bcd68f9-db0e-4dd0-a831-c985e575ff9e'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:42 user nova-compute[75026]: INFO os_vif [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8c:86,bridge_name='br-int',has_traffic_filtering=True,id=b2b60a7f-6664-4ecd-8cf6-c4803546ee32,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b60a7f-66')
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No VIF found with MAC fa:16:3e:89:8c:86, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Successfully updated port: e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquired lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-196632e1-866c-46bc-a172-8c60e509d597 req-40c9db86-03de-423f-aafa-e562764a446d service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updated VIF entry in instance network info cache for port b2b60a7f-6664-4ecd-8cf6-c4803546ee32. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-196632e1-866c-46bc-a172-8c60e509d597 req-40c9db86-03de-423f-aafa-e562764a446d service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-196632e1-866c-46bc-a172-8c60e509d597 req-40c9db86-03de-423f-aafa-e562764a446d service nova] Releasing lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Updating instance_info_cache with network_info: [{"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Releasing lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:27:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Instance network_info: |[{"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:27:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-70542d01-f194-4a67-92f6-f32cee782972 req-d01ec2ff-667a-4695-ba25-fee7f3afff26 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received event network-changed-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:27:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-70542d01-f194-4a67-92f6-f32cee782972 req-d01ec2ff-667a-4695-ba25-fee7f3afff26 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Refreshing instance network info cache due to event network-changed-e20e129d-37c2-469e-aac2-349d1f175fe8. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:27:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70542d01-f194-4a67-92f6-f32cee782972 req-d01ec2ff-667a-4695-ba25-fee7f3afff26 service nova] Acquiring lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:27:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70542d01-f194-4a67-92f6-f32cee782972 req-d01ec2ff-667a-4695-ba25-fee7f3afff26 service nova] Acquired lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:27:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-70542d01-f194-4a67-92f6-f32cee782972 req-d01ec2ff-667a-4695-ba25-fee7f3afff26 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Refreshing network info cache for port e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:27:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-70542d01-f194-4a67-92f6-f32cee782972 req-d01ec2ff-667a-4695-ba25-fee7f3afff26 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Updated VIF entry in instance network info cache for port e20e129d-37c2-469e-aac2-349d1f175fe8. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:27:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-70542d01-f194-4a67-92f6-f32cee782972 req-d01ec2ff-667a-4695-ba25-fee7f3afff26 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Updating instance_info_cache with network_info: [{"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:27:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70542d01-f194-4a67-92f6-f32cee782972 req-d01ec2ff-667a-4695-ba25-fee7f3afff26 service nova] Releasing lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:27:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] No waiting events found dispatching network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:27:45 user nova-compute[75026]: WARNING nova.compute.manager [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received unexpected event network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 for instance with vm_state building and task_state spawning.
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] No waiting events found dispatching network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:27:45 user nova-compute[75026]: WARNING nova.compute.manager [req-01610c4d-a446-479f-afff-b60096b3909b req-d43fb138-68e9-4145-a44f-aaf906eefe74 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received unexpected event network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 for instance with vm_state building and task_state spawning.
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:27:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Instance spawned successfully.
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:27:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:27:46 user nova-compute[75026]: INFO nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 10 19:27:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:27:46 user nova-compute[75026]: INFO nova.compute.manager [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Took 7.83 seconds to build instance.
Nov 10 19:27:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-df800670-0b63-4015-a12e-74690bec9342 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.943s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:27:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:27:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:28:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Creating image(s)
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Ensure instance console log exists: /opt/stack/data/nova/instances/00fbb0b3-a888-4348-ad97-41aed258ff13/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Start _get_guest_xml network_info=[{"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'c9596e69-96ad-47f7-9488-0dc82ec99128', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlyKWYJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00fbb0b3-a888-4348-ad97-41aed258ff13', 'attached_at': '', 'detached_at': '', 'volume_id': 'f64ea220-d986-439c-8954-61477fe1244b', 'serial': 'f64ea220-d986-439c-8954-61477fe1244b'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:28:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:28:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlyKWYJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:28:07 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:28:07 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:28:07 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8522e852-0a5c-4e13-ad7c-7b942cb9eda5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:28:07 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9bb477-bde4-46d8-8ab8-1fe3ba8be967]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b] added
Nov 10 19:28:07 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a28bea-c23f-4c58-aa2e-ca7b49dd06aa]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a433a479-b8fd-4d15-8154-a9bcc2ba74db]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlyKWYJq {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlyKWYJq" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[271f55db-3495-4909-baf7-95ac4b3f1dbf]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IlyKWYJq'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:28:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[181b6890-1429-421a-a77d-73fa5d5c1f20]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7ed31e-c010-4799-aea3-83544ee15765]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:28:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:28:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6646f5-7469-4379-9cb8-c353af89381e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b, portal: 172.16.0.220,3260]
Nov 10 19:28:08 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b, portal: 172.16.0.220,3260] successful.
Nov 10 19:28:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1862db-c9a2-4670-af9a-dc67028cdca4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e468eb45-9e5e-4c09-b1f2-20d3ad3d4f38]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:28:08 user nova-compute[75026]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:28:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:28:08 user nova-compute[75026]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:28:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7628bd0c-76cf-4cc8-9d16-589e73a1f065]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlyKWYJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:28:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26566303563356461', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566303563356461', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1649925711',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1649925711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1649925711',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkpQfCpxQaJFEIKQWdeC37BqcHxoyU5m4fAuH2Imvs+huMEcaWrTWR4PzPb3+npgHc7zvS91p0CQEVGMzIYNU3S355B0r8qO4jTPr/Ont3bzA+tHWf3L0Umj55A6i6rcQ==',key_name='tempest-keypair-751049902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-wa00uwo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758478b59f94467898696fa7af7cd630',uuid=00fbb0b3-a888-4348-ad97-41aed258ff13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=e20e129d-37c2-469e-aac2-349d1f175fe8,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20e129d-37') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'pci_devices' on Instance uuid 00fbb0b3-a888-4348-ad97-41aed258ff13 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:28:09 user nova-compute[75026]:   <uuid>00fbb0b3-a888-4348-ad97-41aed258ff13</uuid>
Nov 10 19:28:09 user nova-compute[75026]:   <name>instance-00000016</name>
Nov 10 19:28:09 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:28:09 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:28:09 user nova-compute[75026]:   <metadata>
Nov 10 19:28:09 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:28:09 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:28:09 user nova-compute[75026]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1649925711</nova:name>
Nov 10 19:28:09 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:28:07</nova:creationTime>
Nov 10 19:28:09 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:28:09 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:28:09 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:28:09 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:28:09 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:28:09 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:28:09 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:28:09 user nova-compute[75026]:       <nova:owner>
Nov 10 19:28:09 user nova-compute[75026]:         <nova:user uuid="758478b59f94467898696fa7af7cd630">tempest-TestVolumeBootPattern-1182723443-project-member</nova:user>
Nov 10 19:28:09 user nova-compute[75026]:         <nova:project uuid="e509e662d27146fba4f51fd55dbe6f83">tempest-TestVolumeBootPattern-1182723443</nova:project>
Nov 10 19:28:09 user nova-compute[75026]:       </nova:owner>
Nov 10 19:28:09 user nova-compute[75026]:       <nova:ports>
Nov 10 19:28:09 user nova-compute[75026]:         <nova:port uuid="e20e129d-37c2-469e-aac2-349d1f175fe8">
Nov 10 19:28:09 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:28:09 user nova-compute[75026]:         </nova:port>
Nov 10 19:28:09 user nova-compute[75026]:       </nova:ports>
Nov 10 19:28:09 user nova-compute[75026]:     </nova:instance>
Nov 10 19:28:09 user nova-compute[75026]:   </metadata>
Nov 10 19:28:09 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:28:09 user nova-compute[75026]:     <system>
Nov 10 19:28:09 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:28:09 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:28:09 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:28:09 user nova-compute[75026]:       <entry name="serial">00fbb0b3-a888-4348-ad97-41aed258ff13</entry>
Nov 10 19:28:09 user nova-compute[75026]:       <entry name="uuid">00fbb0b3-a888-4348-ad97-41aed258ff13</entry>
Nov 10 19:28:09 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:28:09 user nova-compute[75026]:     </system>
Nov 10 19:28:09 user nova-compute[75026]:   </sysinfo>
Nov 10 19:28:09 user nova-compute[75026]:   <os>
Nov 10 19:28:09 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:28:09 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:28:09 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:28:09 user nova-compute[75026]:   </os>
Nov 10 19:28:09 user nova-compute[75026]:   <features>
Nov 10 19:28:09 user nova-compute[75026]:     <acpi/>
Nov 10 19:28:09 user nova-compute[75026]:     <apic/>
Nov 10 19:28:09 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:28:09 user nova-compute[75026]:   </features>
Nov 10 19:28:09 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:28:09 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:28:09 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:28:09 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:28:09 user nova-compute[75026]:   </clock>
Nov 10 19:28:09 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:28:09 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:28:09 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:28:09 user nova-compute[75026]:   </cpu>
Nov 10 19:28:09 user nova-compute[75026]:   <devices>
Nov 10 19:28:09 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:28:09 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:28:09 user nova-compute[75026]:       <source dev="/dev/sdc"/>
Nov 10 19:28:09 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:28:09 user nova-compute[75026]:       <serial>f64ea220-d986-439c-8954-61477fe1244b</serial>
Nov 10 19:28:09 user nova-compute[75026]:     </disk>
Nov 10 19:28:09 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:28:09 user nova-compute[75026]:       <mac address="fa:16:3e:cd:eb:36"/>
Nov 10 19:28:09 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:28:09 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:28:09 user nova-compute[75026]:       <target dev="tape20e129d-37"/>
Nov 10 19:28:09 user nova-compute[75026]:     </interface>
Nov 10 19:28:09 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:28:09 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/00fbb0b3-a888-4348-ad97-41aed258ff13/console.log" append="off"/>
Nov 10 19:28:09 user nova-compute[75026]:     </serial>
Nov 10 19:28:09 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:28:09 user nova-compute[75026]:     <video>
Nov 10 19:28:09 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:28:09 user nova-compute[75026]:     </video>
Nov 10 19:28:09 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:28:09 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:28:09 user nova-compute[75026]:     </rng>
Nov 10 19:28:09 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:28:09 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:28:09 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:28:09 user nova-compute[75026]:     </memballoon>
Nov 10 19:28:09 user nova-compute[75026]:   </devices>
Nov 10 19:28:09 user nova-compute[75026]: </domain>
Nov 10 19:28:09 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1649925711',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1649925711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1649925711',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkpQfCpxQaJFEIKQWdeC37BqcHxoyU5m4fAuH2Imvs+huMEcaWrTWR4PzPb3+npgHc7zvS91p0CQEVGMzIYNU3S355B0r8qO4jTPr/Ont3bzA+tHWf3L0Umj55A6i6rcQ==',key_name='tempest-keypair-751049902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-wa00uwo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758478b59f94467898696fa7af7cd630',uuid=00fbb0b3-a888-4348-ad97-41aed258ff13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=e20e129d-37c2-469e-aac2-349d1f175fe8,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20e129d-37') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG os_vif [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=e20e129d-37c2-469e-aac2-349d1f175fe8,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20e129d-37') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76f815a2-002d-5bce-a580-ed6f932ca092', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape20e129d-37, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape20e129d-37, col_values=(('qos', UUID('99bccd8b-886b-4208-87d2-6640e59484bb')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape20e129d-37, col_values=(('external_ids', {'iface-id': 'e20e129d-37c2-469e-aac2-349d1f175fe8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:eb:36', 'vm-uuid': '00fbb0b3-a888-4348-ad97-41aed258ff13'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:09 user nova-compute[75026]: INFO os_vif [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=e20e129d-37c2-469e-aac2-349d1f175fe8,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20e129d-37')
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No VIF found with MAC fa:16:3e:cd:eb:36, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:28:09 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updating instance_info_cache with network_info: [{"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-f888a7cc-f582-4e5e-8e70-4fada2e30591" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-f937b088-9188-4b2b-b3ad-f3302afdd809 req-4214b109-5b5b-436a-82e9-45cae00d8725 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received event network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f937b088-9188-4b2b-b3ad-f3302afdd809 req-4214b109-5b5b-436a-82e9-45cae00d8725 service nova] Acquiring lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f937b088-9188-4b2b-b3ad-f3302afdd809 req-4214b109-5b5b-436a-82e9-45cae00d8725 service nova] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f937b088-9188-4b2b-b3ad-f3302afdd809 req-4214b109-5b5b-436a-82e9-45cae00d8725 service nova] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-f937b088-9188-4b2b-b3ad-f3302afdd809 req-4214b109-5b5b-436a-82e9-45cae00d8725 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] No waiting events found dispatching network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:28:11 user nova-compute[75026]: WARNING nova.compute.manager [req-f937b088-9188-4b2b-b3ad-f3302afdd809 req-4214b109-5b5b-436a-82e9-45cae00d8725 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received unexpected event network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 for instance with vm_state building and task_state spawning.
Nov 10 19:28:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:28:13 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Instance spawned successfully.
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:13 user nova-compute[75026]: INFO nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:28:13 user nova-compute[75026]: INFO nova.compute.manager [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Took 34.07 seconds to build instance.
Nov 10 19:28:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5bfed480-35e6-42bb-af24-7a6b9b818f88 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.394s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-178cf0f9-6d7d-4e3d-ae41-f82bd2308b6a req-6bfa6d0d-5685-4e45-8287-01893e0a4f81 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received event network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-178cf0f9-6d7d-4e3d-ae41-f82bd2308b6a req-6bfa6d0d-5685-4e45-8287-01893e0a4f81 service nova] Acquiring lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-178cf0f9-6d7d-4e3d-ae41-f82bd2308b6a req-6bfa6d0d-5685-4e45-8287-01893e0a4f81 service nova] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-178cf0f9-6d7d-4e3d-ae41-f82bd2308b6a req-6bfa6d0d-5685-4e45-8287-01893e0a4f81 service nova] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-178cf0f9-6d7d-4e3d-ae41-f82bd2308b6a req-6bfa6d0d-5685-4e45-8287-01893e0a4f81 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] No waiting events found dispatching network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:28:13 user nova-compute[75026]: WARNING nova.compute.manager [req-178cf0f9-6d7d-4e3d-ae41-f82bd2308b6a req-6bfa6d0d-5685-4e45-8287-01893e0a4f81 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received unexpected event network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 for instance with vm_state active and task_state None.
Nov 10 19:28:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:15 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:28:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:28:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:18 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:28:18 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8185MB free_disk=25.593074798583984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1cb42234-262e-4c9a-9b30-5315e07b5a42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance f888a7cc-f582-4e5e-8e70-4fada2e30591 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 00fbb0b3-a888-4348-ad97-41aed258ff13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:28:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:20 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:28:20 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:28:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:28:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:28:32 user nova-compute[75026]: INFO nova.compute.claims [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Claim successful on node user
Nov 10 19:28:32 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:28:32 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:28:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:28:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:28:32 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:28:32 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:28:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:28:32 user nova-compute[75026]: INFO nova.virt.block_device [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Booting with blank volume at /dev/vda
Nov 10 19:28:32 user nova-compute[75026]: DEBUG nova.policy [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcbd2be26ec84b5d9f6f6638963e870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e468483e8f4f70bd228ff8194d76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:28:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:33 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Successfully created port: 927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Successfully updated port: 927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquired lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-e4618b3a-4ea2-41f7-9e5f-c1df08f4b57f req-669950c0-b530-46da-afe6-d2ebc58f8e72 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-changed-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-e4618b3a-4ea2-41f7-9e5f-c1df08f4b57f req-669950c0-b530-46da-afe6-d2ebc58f8e72 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Refreshing instance network info cache due to event network-changed-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e4618b3a-4ea2-41f7-9e5f-c1df08f4b57f req-669950c0-b530-46da-afe6-d2ebc58f8e72 service nova] Acquiring lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:28:34 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:28:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:28:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Releasing lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:28:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance network_info: |[{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:28:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e4618b3a-4ea2-41f7-9e5f-c1df08f4b57f req-669950c0-b530-46da-afe6-d2ebc58f8e72 service nova] Acquired lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:28:35 user nova-compute[75026]: DEBUG nova.network.neutron [req-e4618b3a-4ea2-41f7-9e5f-c1df08f4b57f req-669950c0-b530-46da-afe6-d2ebc58f8e72 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Refreshing network info cache for port 927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:28:36 user nova-compute[75026]: DEBUG nova.network.neutron [req-e4618b3a-4ea2-41f7-9e5f-c1df08f4b57f req-669950c0-b530-46da-afe6-d2ebc58f8e72 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updated VIF entry in instance network info cache for port 927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:28:36 user nova-compute[75026]: DEBUG nova.network.neutron [req-e4618b3a-4ea2-41f7-9e5f-c1df08f4b57f req-669950c0-b530-46da-afe6-d2ebc58f8e72 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:28:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e4618b3a-4ea2-41f7-9e5f-c1df08f4b57f req-669950c0-b530-46da-afe6-d2ebc58f8e72 service nova] Releasing lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:28:38 user nova-compute[75026]: INFO nova.compute.claims [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Claim successful on node user
Nov 10 19:28:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:28:38 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:28:38 user nova-compute[75026]: DEBUG nova.policy [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23cdc917bddc43489c11d252cde89f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d8f53cedda41f7b122c5d70ba7c3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:28:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Creating image(s)
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "/opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "/opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.214s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.223s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk 1073741824" returned: 0 in 0.059s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Successfully created port: 22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Cannot resize image /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Ensure instance console log exists: /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Successfully updated port: 22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquired lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-3f03574e-342f-4f38-8d9d-6021de6e63b7 req-b16ba521-c71b-4414-a4e4-5e8131fc8877 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received event network-changed-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-3f03574e-342f-4f38-8d9d-6021de6e63b7 req-b16ba521-c71b-4414-a4e4-5e8131fc8877 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Refreshing instance network info cache due to event network-changed-22634108-429f-42b5-ab70-28176c1b589a. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f03574e-342f-4f38-8d9d-6021de6e63b7 req-b16ba521-c71b-4414-a4e4-5e8131fc8877 service nova] Acquiring lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:28:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updating instance_info_cache with network_info: [{"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Releasing lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Instance network_info: |[{"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f03574e-342f-4f38-8d9d-6021de6e63b7 req-b16ba521-c71b-4414-a4e4-5e8131fc8877 service nova] Acquired lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.network.neutron [req-3f03574e-342f-4f38-8d9d-6021de6e63b7 req-b16ba521-c71b-4414-a4e4-5e8131fc8877 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Refreshing network info cache for port 22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Start _get_guest_xml network_info=[{"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:28:41 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:28:41 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1605904584',display_name='tempest-ServerStableDeviceRescueTest-server-1605904584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1605904584',id=24,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSdwHKJUeYG8sDoV5OqB9TAcSuKxvE2IVMxCyOUvMucy6EStHG2Tw31KP9+xxKh51c4av7wLyjfW2cDvfoBi8Tx18YMLlshaALCN8nidevqNhXsYM1WxKoiiWGifFbm8w==',key_name='tempest-keypair-1048311316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92d8f53cedda41f7b122c5d70ba7c3e7',ramdisk_id='',reservation_id='r-qnljx7a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1163467638',owner_user_name='tempest-ServerStableDeviceRescueTest-1163467638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23cdc917bddc43489c11d252cde89f0c',uuid=b5a70279-1a95-4c83-8243-b3bcb06fdbee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Converting VIF {"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:2a:6f,bridge_name='br-int',has_traffic_filtering=True,id=22634108-429f-42b5-ab70-28176c1b589a,network=Network(b50a3bd7-62f0-409c-b7e7-07e8fffa3097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22634108-42') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lazy-loading 'pci_devices' on Instance uuid b5a70279-1a95-4c83-8243-b3bcb06fdbee {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:28:41 user nova-compute[75026]:   <uuid>b5a70279-1a95-4c83-8243-b3bcb06fdbee</uuid>
Nov 10 19:28:41 user nova-compute[75026]:   <name>instance-00000018</name>
Nov 10 19:28:41 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:28:41 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:28:41 user nova-compute[75026]:   <metadata>
Nov 10 19:28:41 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:28:41 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:28:41 user nova-compute[75026]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1605904584</nova:name>
Nov 10 19:28:41 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:28:41</nova:creationTime>
Nov 10 19:28:41 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:28:41 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:28:41 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:28:41 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:28:41 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:28:41 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:28:41 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:28:41 user nova-compute[75026]:       <nova:owner>
Nov 10 19:28:41 user nova-compute[75026]:         <nova:user uuid="23cdc917bddc43489c11d252cde89f0c">tempest-ServerStableDeviceRescueTest-1163467638-project-member</nova:user>
Nov 10 19:28:41 user nova-compute[75026]:         <nova:project uuid="92d8f53cedda41f7b122c5d70ba7c3e7">tempest-ServerStableDeviceRescueTest-1163467638</nova:project>
Nov 10 19:28:41 user nova-compute[75026]:       </nova:owner>
Nov 10 19:28:41 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:28:41 user nova-compute[75026]:       <nova:ports>
Nov 10 19:28:41 user nova-compute[75026]:         <nova:port uuid="22634108-429f-42b5-ab70-28176c1b589a">
Nov 10 19:28:41 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:28:41 user nova-compute[75026]:         </nova:port>
Nov 10 19:28:41 user nova-compute[75026]:       </nova:ports>
Nov 10 19:28:41 user nova-compute[75026]:     </nova:instance>
Nov 10 19:28:41 user nova-compute[75026]:   </metadata>
Nov 10 19:28:41 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:28:41 user nova-compute[75026]:     <system>
Nov 10 19:28:41 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:28:41 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:28:41 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:28:41 user nova-compute[75026]:       <entry name="serial">b5a70279-1a95-4c83-8243-b3bcb06fdbee</entry>
Nov 10 19:28:41 user nova-compute[75026]:       <entry name="uuid">b5a70279-1a95-4c83-8243-b3bcb06fdbee</entry>
Nov 10 19:28:41 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:28:41 user nova-compute[75026]:     </system>
Nov 10 19:28:41 user nova-compute[75026]:   </sysinfo>
Nov 10 19:28:41 user nova-compute[75026]:   <os>
Nov 10 19:28:41 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:28:41 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:28:41 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:28:41 user nova-compute[75026]:   </os>
Nov 10 19:28:41 user nova-compute[75026]:   <features>
Nov 10 19:28:41 user nova-compute[75026]:     <acpi/>
Nov 10 19:28:41 user nova-compute[75026]:     <apic/>
Nov 10 19:28:41 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:28:41 user nova-compute[75026]:   </features>
Nov 10 19:28:41 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:28:41 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:28:41 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:28:41 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:28:41 user nova-compute[75026]:   </clock>
Nov 10 19:28:41 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:28:41 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:28:41 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:28:41 user nova-compute[75026]:   </cpu>
Nov 10 19:28:41 user nova-compute[75026]:   <devices>
Nov 10 19:28:41 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:28:41 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:28:41 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk"/>
Nov 10 19:28:41 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:28:41 user nova-compute[75026]:     </disk>
Nov 10 19:28:41 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:28:41 user nova-compute[75026]:       <mac address="fa:16:3e:8a:2a:6f"/>
Nov 10 19:28:41 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:28:41 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:28:41 user nova-compute[75026]:       <target dev="tap22634108-42"/>
Nov 10 19:28:41 user nova-compute[75026]:     </interface>
Nov 10 19:28:41 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:28:41 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/console.log" append="off"/>
Nov 10 19:28:41 user nova-compute[75026]:     </serial>
Nov 10 19:28:41 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:28:41 user nova-compute[75026]:     <video>
Nov 10 19:28:41 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:28:41 user nova-compute[75026]:     </video>
Nov 10 19:28:41 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:28:41 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:28:41 user nova-compute[75026]:     </rng>
Nov 10 19:28:41 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:28:41 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:28:41 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:28:41 user nova-compute[75026]:     </memballoon>
Nov 10 19:28:41 user nova-compute[75026]:   </devices>
Nov 10 19:28:41 user nova-compute[75026]: </domain>
Nov 10 19:28:41 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1605904584',display_name='tempest-ServerStableDeviceRescueTest-server-1605904584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1605904584',id=24,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSdwHKJUeYG8sDoV5OqB9TAcSuKxvE2IVMxCyOUvMucy6EStHG2Tw31KP9+xxKh51c4av7wLyjfW2cDvfoBi8Tx18YMLlshaALCN8nidevqNhXsYM1WxKoiiWGifFbm8w==',key_name='tempest-keypair-1048311316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92d8f53cedda41f7b122c5d70ba7c3e7',ramdisk_id='',reservation_id='r-qnljx7a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1163467638',owner_user_name='tempest-ServerStableDeviceRescueTest-1163467638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23cdc917bddc43489c11d252cde89f0c',uuid=b5a70279-1a95-4c83-8243-b3bcb06fdbee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Converting VIF {"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:2a:6f,bridge_name='br-int',has_traffic_filtering=True,id=22634108-429f-42b5-ab70-28176c1b589a,network=Network(b50a3bd7-62f0-409c-b7e7-07e8fffa3097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22634108-42') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG os_vif [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:2a:6f,bridge_name='br-int',has_traffic_filtering=True,id=22634108-429f-42b5-ab70-28176c1b589a,network=Network(b50a3bd7-62f0-409c-b7e7-07e8fffa3097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22634108-42') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd516732f-6894-55b3-ab8b-49be9ff9bb75', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22634108-42, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22634108-42, col_values=(('qos', UUID('041767e4-777f-4815-bb63-8cbd5aa8f492')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22634108-42, col_values=(('external_ids', {'iface-id': '22634108-429f-42b5-ab70-28176c1b589a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:2a:6f', 'vm-uuid': 'b5a70279-1a95-4c83-8243-b3bcb06fdbee'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:41 user nova-compute[75026]: INFO os_vif [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:2a:6f,bridge_name='br-int',has_traffic_filtering=True,id=22634108-429f-42b5-ab70-28176c1b589a,network=Network(b50a3bd7-62f0-409c-b7e7-07e8fffa3097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22634108-42')
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] No VIF found with MAC fa:16:3e:8a:2a:6f, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.network.neutron [req-3f03574e-342f-4f38-8d9d-6021de6e63b7 req-b16ba521-c71b-4414-a4e4-5e8131fc8877 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updated VIF entry in instance network info cache for port 22634108-429f-42b5-ab70-28176c1b589a. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG nova.network.neutron [req-3f03574e-342f-4f38-8d9d-6021de6e63b7 req-b16ba521-c71b-4414-a4e4-5e8131fc8877 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updating instance_info_cache with network_info: [{"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:28:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f03574e-342f-4f38-8d9d-6021de6e63b7 req-b16ba521-c71b-4414-a4e4-5e8131fc8877 service nova] Releasing lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:28:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-9139a5e9-9903-4179-a14c-202e03848d1c req-eb31d7e4-3597-4257-ba46-a420a214910e service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received event network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9139a5e9-9903-4179-a14c-202e03848d1c req-eb31d7e4-3597-4257-ba46-a420a214910e service nova] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9139a5e9-9903-4179-a14c-202e03848d1c req-eb31d7e4-3597-4257-ba46-a420a214910e service nova] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9139a5e9-9903-4179-a14c-202e03848d1c req-eb31d7e4-3597-4257-ba46-a420a214910e service nova] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-9139a5e9-9903-4179-a14c-202e03848d1c req-eb31d7e4-3597-4257-ba46-a420a214910e service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] No waiting events found dispatching network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:28:43 user nova-compute[75026]: WARNING nova.compute.manager [req-9139a5e9-9903-4179-a14c-202e03848d1c req-eb31d7e4-3597-4257-ba46-a420a214910e service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received unexpected event network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a for instance with vm_state building and task_state spawning.
Nov 10 19:28:43 user nova-compute[75026]: INFO nova.compute.manager [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Detaching volume ddea0b8f-7b86-4d04-bfda-675a0262d97a
Nov 10 19:28:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:43 user nova-compute[75026]: INFO nova.virt.block_device [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Attempting to driver detach volume ddea0b8f-7b86-4d04-bfda-675a0262d97a from mountpoint /dev/vdb
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG os_brick.utils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Attempting to detach device vdb from instance f888a7cc-f582-4e5e-8e70-4fada2e30591 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:28:43 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:28:43 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:28:43 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:28:43 user nova-compute[75026]:   <serial>ddea0b8f-7b86-4d04-bfda-675a0262d97a</serial>
Nov 10 19:28:43 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:28:43 user nova-compute[75026]: </disk>
Nov 10 19:28:43 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a2ab6-b2f9-4854-a6be-033e35c74530]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Successfully detached device vdb from instance f888a7cc-f582-4e5e-8e70-4fada2e30591 from the persistent domain config.
Nov 10 19:28:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f888a7cc-f582-4e5e-8e70-4fada2e30591 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:28:43 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:28:43 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:28:43 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:28:43 user nova-compute[75026]:   <serial>ddea0b8f-7b86-4d04-bfda-675a0262d97a</serial>
Nov 10 19:28:43 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:28:43 user nova-compute[75026]: </disk>
Nov 10 19:28:43 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87b3532-1625-4cba-b10c-d8449e3e808d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad3ff5-39e2-44e5-95bf-086efd585739]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10857084-ac94-4a52-8d4e-dea5047e894d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:28:43 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:28:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[764a6010-f287-4663-ab80-f14b50f5d06f]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG os_brick.utils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:28:43 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating existing volume attachment record: 64363ef4-a864-433c-9e62-71ff664cd414 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:28:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f888a7cc-f582-4e5e-8e70-4fada2e30591 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:28:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Instance spawned successfully.
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-f317439d-c451-4373-875f-597c6d3e3bc1 req-d7a86756-e3fe-4248-aa76-61e8f4fd0576 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received event network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f317439d-c451-4373-875f-597c6d3e3bc1 req-d7a86756-e3fe-4248-aa76-61e8f4fd0576 service nova] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f317439d-c451-4373-875f-597c6d3e3bc1 req-d7a86756-e3fe-4248-aa76-61e8f4fd0576 service nova] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f317439d-c451-4373-875f-597c6d3e3bc1 req-d7a86756-e3fe-4248-aa76-61e8f4fd0576 service nova] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-f317439d-c451-4373-875f-597c6d3e3bc1 req-d7a86756-e3fe-4248-aa76-61e8f4fd0576 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] No waiting events found dispatching network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:28:45 user nova-compute[75026]: WARNING nova.compute.manager [req-f317439d-c451-4373-875f-597c6d3e3bc1 req-d7a86756-e3fe-4248-aa76-61e8f4fd0576 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received unexpected event network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a for instance with vm_state building and task_state spawning.
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:28:45 user nova-compute[75026]: INFO nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Took 6.67 seconds to spawn the instance on the hypervisor.
Nov 10 19:28:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:28:45 user nova-compute[75026]: INFO nova.compute.manager [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Took 7.50 seconds to build instance.
Nov 10 19:28:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1002bb49-d3cd-4abb-aa16-98db3ad0d6e1 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.615s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:28:51 user nova-compute[75026]: INFO nova.compute.claims [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Claim successful on node user
Nov 10 19:28:51 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:28:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:28:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:28:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG nova.policy [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2431c27d25041fa91adb7e38b319682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6368f0d1abea492eb4b57d5243bb074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:28:52 user nova-compute[75026]: INFO nova.virt.block_device [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Booting with volume 58dcd553-406e-46b2-aea9-c3d72298d832 at /dev/vda
Nov 10 19:28:52 user nova-compute[75026]: DEBUG os_brick.utils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac540c1-98c9-4f7e-b26e-14515a76f5ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb85887-30ac-4de6-ad2a-901d41fb8e3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f187a1-0e91-4202-80cc-12cbdb467392]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedf17b7-dad2-4094-a545-0824b1fb3b51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:28:52 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:28:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c83e07-1287-4c2d-bdac-e8717616c2ad]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG os_brick.utils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updating existing volume attachment record: 578b113f-4b42-458c-9d5f-9b1577de4a87 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:28:52 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Successfully created port: bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Successfully updated port: bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquired lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-5d84879b-5138-4f36-9c2b-5ab0f9697724 req-4ca38339-4cbd-4956-a523-0fd13ea75d7a service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received event network-changed-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-5d84879b-5138-4f36-9c2b-5ab0f9697724 req-4ca38339-4cbd-4956-a523-0fd13ea75d7a service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Refreshing instance network info cache due to event network-changed-bb533d1f-0b83-47a2-9592-34de09911b5f. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5d84879b-5138-4f36-9c2b-5ab0f9697724 req-4ca38339-4cbd-4956-a523-0fd13ea75d7a service nova] Acquiring lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updating instance_info_cache with network_info: [{"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Releasing lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Instance network_info: |[{"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5d84879b-5138-4f36-9c2b-5ab0f9697724 req-4ca38339-4cbd-4956-a523-0fd13ea75d7a service nova] Acquired lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:28:53 user nova-compute[75026]: DEBUG nova.network.neutron [req-5d84879b-5138-4f36-9c2b-5ab0f9697724 req-4ca38339-4cbd-4956-a523-0fd13ea75d7a service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Refreshing network info cache for port bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:28:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-5d84879b-5138-4f36-9c2b-5ab0f9697724 req-4ca38339-4cbd-4956-a523-0fd13ea75d7a service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updated VIF entry in instance network info cache for port bb533d1f-0b83-47a2-9592-34de09911b5f. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:28:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-5d84879b-5138-4f36-9c2b-5ab0f9697724 req-4ca38339-4cbd-4956-a523-0fd13ea75d7a service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updating instance_info_cache with network_info: [{"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:28:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5d84879b-5138-4f36-9c2b-5ab0f9697724 req-4ca38339-4cbd-4956-a523-0fd13ea75d7a service nova] Releasing lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:28:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:28:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:04 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f888a7cc-f582-4e5e-8e70-4fada2e30591 is timed out.
Nov 10 19:29:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Successfully detached device vdb from instance f888a7cc-f582-4e5e-8e70-4fada2e30591 from the live domain config.
Nov 10 19:29:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNqgwmGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:29:04 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b41cfcc-f307-431d-a7bb-94e70fe78918]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:29:04 user nova-compute[75026]: No targets found.
Nov 10 19:29:04 user nova-compute[75026]: iSNS:
Nov 10 19:29:04 user nova-compute[75026]: No targets found.
Nov 10 19:29:04 user nova-compute[75026]: STATIC:
Nov 10 19:29:04 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a
Nov 10 19:29:04 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:29:04 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:29:04 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b
Nov 10 19:29:04 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:29:04 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:29:04 user nova-compute[75026]: FIRMWARE:
Nov 10 19:29:04 user nova-compute[75026]: No targets found.
Nov 10 19:29:04 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:29:04 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:29:04 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5029fa-0f4e-4755-b8f3-c9ae72f11a74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7616645-bf89-4066-821e-e4852503f047]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:29:04 user nova-compute[75026]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:29:04 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a (non-flash)
Nov 10 19:29:04 user nova-compute[75026]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:29:04 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed8020c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57efdff-32a0-4501-8219-3ea2fa356f08]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb8b04-43b9-4d17-9595-e3a2a6b838a2]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9fc07b-69ef-4d08-9ca3-4d38bb56019d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f147a2e1-acaf-49d9-a598-801c89c4ab74]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[600ee05e-956f-475c-83c8-ad62b7e43159]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab696aa-fa5b-43da-a437-abd055e69b2e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a, portal: 172.16.0.220,3260]
Nov 10 19:29:04 user nova-compute[75026]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a, portal: 172.16.0.220,3260] successful.
Nov 10 19:29:04 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd9a391-0cfe-4eb7-820d-ab92ea2ee04a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] <== disconnect_volume: return (331ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:29:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:29:05 user nova-compute[75026]: DEBUG nova.objects.instance [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'flavor' on Instance uuid f888a7cc-f582-4e5e-8e70-4fada2e30591 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:29:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-97191850-de24-48ea-ba73-cf9b12bbf9a6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.413s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.261s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:05 user nova-compute[75026]: INFO nova.compute.manager [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Terminating instance
Nov 10 19:29:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-20ed81c8-3cf9-4975-b10d-7e7c900b6d73 req-696928f6-7e6b-4446-a07d-45d77fd99d12 service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received event network-vif-unplugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20ed81c8-3cf9-4975-b10d-7e7c900b6d73 req-696928f6-7e6b-4446-a07d-45d77fd99d12 service nova] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20ed81c8-3cf9-4975-b10d-7e7c900b6d73 req-696928f6-7e6b-4446-a07d-45d77fd99d12 service nova] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20ed81c8-3cf9-4975-b10d-7e7c900b6d73 req-696928f6-7e6b-4446-a07d-45d77fd99d12 service nova] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-20ed81c8-3cf9-4975-b10d-7e7c900b6d73 req-696928f6-7e6b-4446-a07d-45d77fd99d12 service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] No waiting events found dispatching network-vif-unplugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-20ed81c8-3cf9-4975-b10d-7e7c900b6d73 req-696928f6-7e6b-4446-a07d-45d77fd99d12 service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received event network-vif-unplugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:29:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:06 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Instance destroyed successfully.
Nov 10 19:29:06 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'resources' on Instance uuid f888a7cc-f582-4e5e-8e70-4fada2e30591 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-586203153',display_name='tempest-VolumesSnapshotTestJSON-instance-586203153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-586203153',id=17,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz5k/6fEXDYqd27EN6La0ckHLAMY+FyOYGTb8ROihZHjsjUwyjngJCx8yXWRG8GHGjVJTXQtefA6LWkHRE9zC+9yrw4XV/12Mu3jVEfGI+2FEBRHCMcyU9HcEs4PMC93A==',key_name='tempest-keypair-525285770',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50ae442a2faf4481a3fb87b1c7ea53bf',ramdisk_id='',reservation_id='r-bx7m7rnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1891642589',owner_user_name='tempest-VolumesSnapshotTestJSON-1891642589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f95e8bc5971d4c06b6755ad1f63c6856',uuid=f888a7cc-f582-4e5e-8e70-4fada2e30591,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converting VIF {"id": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "address": "fa:16:3e:65:80:f9", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd88a6d2-ca", "ovs_interfaceid": "dd88a6d2-cac6-453c-bddd-074cdf43f560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:80:f9,bridge_name='br-int',has_traffic_filtering=True,id=dd88a6d2-cac6-453c-bddd-074cdf43f560,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd88a6d2-ca') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_vif [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:80:f9,bridge_name='br-int',has_traffic_filtering=True,id=dd88a6d2-cac6-453c-bddd-074cdf43f560,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd88a6d2-ca') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd88a6d2-ca, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=379d9dcc-d257-41ec-9c29-f9a011f232aa) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:29:07 user nova-compute[75026]: INFO os_vif [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:80:f9,bridge_name='br-int',has_traffic_filtering=True,id=dd88a6d2-cac6-453c-bddd-074cdf43f560,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd88a6d2-ca')
Nov 10 19:29:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNqgwmGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:29:07 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec3c06-9b65-46f3-8e1e-d34dc56d2c80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:29:07 user nova-compute[75026]: No targets found.
Nov 10 19:29:07 user nova-compute[75026]: iSNS:
Nov 10 19:29:07 user nova-compute[75026]: No targets found.
Nov 10 19:29:07 user nova-compute[75026]: STATIC:
Nov 10 19:29:07 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b
Nov 10 19:29:07 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:29:07 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:29:07 user nova-compute[75026]: FIRMWARE:
Nov 10 19:29:07 user nova-compute[75026]: No targets found.
Nov 10 19:29:07 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:29:07 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:29:07 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddea0b8f-7b86-4d04-bfda-675a0262d97a', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b88749f-1031-4d9c-ade8-66706075ce81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b714e725-00a0-49b6-bb93-1d719d0ee383]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:29:07 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:29:07 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed983d9630>, {}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Disconnecting from: [] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] <== disconnect_volume: return (74ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:29:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Deleting instance files /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591_del
Nov 10 19:29:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Deletion of /opt/stack/data/nova/instances/f888a7cc-f582-4e5e-8e70-4fada2e30591_del complete
Nov 10 19:29:07 user nova-compute[75026]: INFO nova.compute.manager [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 10 19:29:07 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:29:07 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:29:08 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Took 0.99 seconds to deallocate network for instance.
Nov 10 19:29:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-d8d3ceff-596d-4a6b-b5a9-a395f8c628e5 req-a9566de9-7b1f-4108-b4ce-15dd850b9895 service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received event network-vif-deleted-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:08 user nova-compute[75026]: WARNING nova.volume.cinder [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Attachment 50344f02-43ae-446e-8ab1-c79d5e35b98e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 50344f02-43ae-446e-8ab1-c79d5e35b98e. (HTTP 404) (Request-ID: req-f59343d4-6fd4-41a7-9297-8e3ac05b7809)
Nov 10 19:29:08 user nova-compute[75026]: INFO nova.compute.manager [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Took 0.08 seconds to detach 1 volumes for instance.
Nov 10 19:29:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-37b50f1a-c5de-4d8b-80d4-0d28d835fc2b req-b2d9ddf5-bf10-4c84-9d42-c86b56a6855e service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received event network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-37b50f1a-c5de-4d8b-80d4-0d28d835fc2b req-b2d9ddf5-bf10-4c84-9d42-c86b56a6855e service nova] Acquiring lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-37b50f1a-c5de-4d8b-80d4-0d28d835fc2b req-b2d9ddf5-bf10-4c84-9d42-c86b56a6855e service nova] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-37b50f1a-c5de-4d8b-80d4-0d28d835fc2b req-b2d9ddf5-bf10-4c84-9d42-c86b56a6855e service nova] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-37b50f1a-c5de-4d8b-80d4-0d28d835fc2b req-b2d9ddf5-bf10-4c84-9d42-c86b56a6855e service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] No waiting events found dispatching network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:08 user nova-compute[75026]: WARNING nova.compute.manager [req-37b50f1a-c5de-4d8b-80d4-0d28d835fc2b req-b2d9ddf5-bf10-4c84-9d42-c86b56a6855e service nova] [instance: f888a7cc-f582-4e5e-8e70-4fada2e30591] Received unexpected event network-vif-plugged-dd88a6d2-cac6-453c-bddd-074cdf43f560 for instance with vm_state active and task_state deleting.
Nov 10 19:29:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:29:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:09 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Deleted allocations for instance f888a7cc-f582-4e5e-8e70-4fada2e30591
Nov 10 19:29:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c924cd8d-924d-4adf-bec4-7349b5782e0e tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "f888a7cc-f582-4e5e-8e70-4fada2e30591" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:29:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:29:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:29:10 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:29:11 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updating instance_info_cache with network_info: [{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:29:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:29:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:29:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:13 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:16 user nova-compute[75026]: INFO nova.compute.manager [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Terminating instance
Nov 10 19:29:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:29:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-e631c8a2-56dd-42b5-81e8-504a54e02b0d req-b467a960-8c61-4b22-9b2d-9c2d84d89655 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-unplugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e631c8a2-56dd-42b5-81e8-504a54e02b0d req-b467a960-8c61-4b22-9b2d-9c2d84d89655 service nova] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e631c8a2-56dd-42b5-81e8-504a54e02b0d req-b467a960-8c61-4b22-9b2d-9c2d84d89655 service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e631c8a2-56dd-42b5-81e8-504a54e02b0d req-b467a960-8c61-4b22-9b2d-9c2d84d89655 service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-e631c8a2-56dd-42b5-81e8-504a54e02b0d req-b467a960-8c61-4b22-9b2d-9c2d84d89655 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] No waiting events found dispatching network-vif-unplugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-e631c8a2-56dd-42b5-81e8-504a54e02b0d req-b467a960-8c61-4b22-9b2d-9c2d84d89655 service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-unplugged-b04da179-c3e9-4063-b77f-2c8c8a43801f for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Instance destroyed successfully.
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.objects.instance [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'resources' on Instance uuid 1cb42234-262e-4c9a-9b30-5315e07b5a42 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-727980199',display_name='tempest-AttachVolumeNegativeTest-server-727980199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-727980199',id=16,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNySllGVspGFUsFIww9ntxk1YrtYnUjdXDUvmYoB2LW/fCNmtyCpSE1sy8Y5a7LqYy9AWuTALLifvMjJwDV9P5wIWZ2iinROD+52H3JGrKY859L82JcvYv3hAWlm7Ulp1A==',key_name='tempest-keypair-1206273795',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-1h0g67ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:24:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=1cb42234-262e-4c9a-9b30-5315e07b5a42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "address": "fa:16:3e:ec:55:30", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04da179-c3", "ovs_interfaceid": "b04da179-c3e9-4063-b77f-2c8c8a43801f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:55:30,bridge_name='br-int',has_traffic_filtering=True,id=b04da179-c3e9-4063-b77f-2c8c8a43801f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04da179-c3') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG os_vif [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:55:30,bridge_name='br-int',has_traffic_filtering=True,id=b04da179-c3e9-4063-b77f-2c8c8a43801f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04da179-c3') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb04da179-c3, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdb68d60-59ca-40be-a85b-22c81353da8c) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: INFO os_vif [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:55:30,bridge_name='br-int',has_traffic_filtering=True,id=b04da179-c3e9-4063-b77f-2c8c8a43801f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04da179-c3')
Nov 10 19:29:17 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Deleting instance files /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42_del
Nov 10 19:29:17 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Deletion of /opt/stack/data/nova/instances/1cb42234-262e-4c9a-9b30-5315e07b5a42_del complete
Nov 10 19:29:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:17 user nova-compute[75026]: INFO nova.compute.manager [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:29:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:18 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid '1cb42234-262e-4c9a-9b30-5315e07b5a42' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid '1cb42234-262e-4c9a-9b30-5315e07b5a42' (instance-00000010)
Nov 10 19:29:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:29:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:18 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:29:18 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:29:18 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8042MB free_disk=25.578594207763672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:29:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1cb42234-262e-4c9a-9b30-5315e07b5a42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 00fbb0b3-a888-4348-ad97-41aed258ff13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5a70279-1a95-4c83-8243-b3bcb06fdbee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:29:19 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Took 1.29 seconds to deallocate network for instance.
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:29:19 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Creating image(s)
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Ensure instance console log exists: /opt/stack/data/nova/instances/b5d275d9-e5fe-425c-9dfb-270a989a6872/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Start _get_guest_xml network_info=[{"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '578b113f-4b42-458c-9d5f-9b1577de4a87', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DltiSprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5d275d9-e5fe-425c-9dfb-270a989a6872', 'attached_at': '', 'detached_at': '', 'volume_id': '58dcd553-406e-46b2-aea9-c3d72298d832', 'serial': '58dcd553-406e-46b2-aea9-c3d72298d832'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-bc26de3d-ad7c-482b-8053-525a582df084 req-ceff5e46-4db5-44c8-a1f6-190094607bda service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-deleted-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:19 user nova-compute[75026]: INFO nova.compute.manager [req-bc26de3d-ad7c-482b-8053-525a582df084 req-ceff5e46-4db5-44c8-a1f6-190094607bda service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Neutron deleted interface b04da179-c3e9-4063-b77f-2c8c8a43801f; detaching it from the instance and deleting it from the info cache
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-bc26de3d-ad7c-482b-8053-525a582df084 req-ceff5e46-4db5-44c8-a1f6-190094607bda service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:29:19 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:29:19 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-bc26de3d-ad7c-482b-8053-525a582df084 req-ceff5e46-4db5-44c8-a1f6-190094607bda service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Detach interface failed, port_id=b04da179-c3e9-4063-b77f-2c8c8a43801f, reason: Instance 1cb42234-262e-4c9a-9b30-5315e07b5a42 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DltiSprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:29:19 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:29:19 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:29:19 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4545d66e-924b-4364-8286-8be9106325ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:29:19 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7acb0f-b47b-49d2-9851-22d5d1240a28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832] added
Nov 10 19:29:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4561e56e-76c7-4211-a54d-23cf18b394f7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3107053-3528-42b9-948c-a94860643f26]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DltiSprs {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DltiSprs" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd50a7a4-515b-45eb-9f8e-732aae68515b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DltiSprs'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] No waiting events found dispatching network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:19 user nova-compute[75026]: WARNING nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received unexpected event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f for instance with vm_state deleted and task_state None.
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] No waiting events found dispatching network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:19 user nova-compute[75026]: WARNING nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received unexpected event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f for instance with vm_state deleted and task_state None.
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] No waiting events found dispatching network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:19 user nova-compute[75026]: WARNING nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received unexpected event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f for instance with vm_state deleted and task_state None.
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-unplugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] No waiting events found dispatching network-vif-unplugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:19 user nova-compute[75026]: WARNING nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received unexpected event network-vif-unplugged-b04da179-c3e9-4063-b77f-2c8c8a43801f for instance with vm_state deleted and task_state None.
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Acquiring lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] No waiting events found dispatching network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:19 user nova-compute[75026]: WARNING nova.compute.manager [req-be6b2ba2-1612-4435-b799-a77a43d158a9 req-25c882ad-8a28-4315-9db4-13df76f9589c service nova] [instance: 1cb42234-262e-4c9a-9b30-5315e07b5a42] Received unexpected event network-vif-plugged-b04da179-c3e9-4063-b77f-2c8c8a43801f for instance with vm_state deleted and task_state None.
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[818f178c-e2c0-45de-8e77-ec0fd5a50547]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f3437-c92a-4429-a104-008be1b25b28]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:29:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:29:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.176s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bbd621-1072-4d48-99f7-7c93d29f2e9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832, portal: 172.16.0.220,3260]
Nov 10 19:29:19 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832, portal: 172.16.0.220,3260] successful.
Nov 10 19:29:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ffb57b-3cfd-46d6-855a-fedd727a988e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20942d7-8719-40da-b0a1-6c6de409d0d6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:29:19 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:29:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:29:19 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:29:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5527824e-8193-41c1-b9bc-83c3b4ca54d7]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:19 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Deleted allocations for instance 1cb42234-262e-4c9a-9b30-5315e07b5a42
Nov 10 19:29:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-64e7aa84-5500-4fa8-83dd-8db107c4c9f7 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "1cb42234-262e-4c9a-9b30-5315e07b5a42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.927s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DltiSprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23263653664636562', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263653664636562', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1064278232',display_name='tempest-TestShelveInstance-server-1064278232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1064278232',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIcG06meqhA5bz7nbSQbZnjNzSgJzS3zy+v9ArBM3fHe0Y+Lof0p4LlRhMVALo/dQrCRaepIdoB64mOCskZ5yShq/6cu+uotc8QF8do1Lx7g6WPDNmgW5lwgIq+YzbuWQ==',key_name='tempest-TestShelveInstance-380999352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6368f0d1abea492eb4b57d5243bb074d',ramdisk_id='',reservation_id='r-q11ebfki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-731674373',owner_user_name='tempest-TestShelveInstance-731674373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:28:52Z,user_data=None,user_id='c2431c27d25041fa91adb7e38b319682',uuid=b5d275d9-e5fe-425c-9dfb-270a989a6872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Converting VIF {"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2b:6b,bridge_name='br-int',has_traffic_filtering=True,id=bb533d1f-0b83-47a2-9592-34de09911b5f,network=Network(b7c41db0-c65b-448c-a432-39764644c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb533d1f-0b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.objects.instance [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lazy-loading 'pci_devices' on Instance uuid b5d275d9-e5fe-425c-9dfb-270a989a6872 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:29:20 user nova-compute[75026]:   <uuid>b5d275d9-e5fe-425c-9dfb-270a989a6872</uuid>
Nov 10 19:29:20 user nova-compute[75026]:   <name>instance-00000019</name>
Nov 10 19:29:20 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:29:20 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:29:20 user nova-compute[75026]:   <metadata>
Nov 10 19:29:20 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:29:20 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:29:20 user nova-compute[75026]:       <nova:name>tempest-TestShelveInstance-server-1064278232</nova:name>
Nov 10 19:29:20 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:29:19</nova:creationTime>
Nov 10 19:29:20 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:29:20 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:29:20 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:29:20 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:29:20 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:29:20 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:29:20 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:29:20 user nova-compute[75026]:       <nova:owner>
Nov 10 19:29:20 user nova-compute[75026]:         <nova:user uuid="c2431c27d25041fa91adb7e38b319682">tempest-TestShelveInstance-731674373-project-member</nova:user>
Nov 10 19:29:20 user nova-compute[75026]:         <nova:project uuid="6368f0d1abea492eb4b57d5243bb074d">tempest-TestShelveInstance-731674373</nova:project>
Nov 10 19:29:20 user nova-compute[75026]:       </nova:owner>
Nov 10 19:29:20 user nova-compute[75026]:       <nova:ports>
Nov 10 19:29:20 user nova-compute[75026]:         <nova:port uuid="bb533d1f-0b83-47a2-9592-34de09911b5f">
Nov 10 19:29:20 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:29:20 user nova-compute[75026]:         </nova:port>
Nov 10 19:29:20 user nova-compute[75026]:       </nova:ports>
Nov 10 19:29:20 user nova-compute[75026]:     </nova:instance>
Nov 10 19:29:20 user nova-compute[75026]:   </metadata>
Nov 10 19:29:20 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:29:20 user nova-compute[75026]:     <system>
Nov 10 19:29:20 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:29:20 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:29:20 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:29:20 user nova-compute[75026]:       <entry name="serial">b5d275d9-e5fe-425c-9dfb-270a989a6872</entry>
Nov 10 19:29:20 user nova-compute[75026]:       <entry name="uuid">b5d275d9-e5fe-425c-9dfb-270a989a6872</entry>
Nov 10 19:29:20 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:29:20 user nova-compute[75026]:     </system>
Nov 10 19:29:20 user nova-compute[75026]:   </sysinfo>
Nov 10 19:29:20 user nova-compute[75026]:   <os>
Nov 10 19:29:20 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:29:20 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:29:20 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:29:20 user nova-compute[75026]:   </os>
Nov 10 19:29:20 user nova-compute[75026]:   <features>
Nov 10 19:29:20 user nova-compute[75026]:     <acpi/>
Nov 10 19:29:20 user nova-compute[75026]:     <apic/>
Nov 10 19:29:20 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:29:20 user nova-compute[75026]:   </features>
Nov 10 19:29:20 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:29:20 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:29:20 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:29:20 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:29:20 user nova-compute[75026]:   </clock>
Nov 10 19:29:20 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:29:20 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:29:20 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:29:20 user nova-compute[75026]:   </cpu>
Nov 10 19:29:20 user nova-compute[75026]:   <devices>
Nov 10 19:29:20 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:29:20 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:29:20 user nova-compute[75026]:       <source dev="/dev/sdb"/>
Nov 10 19:29:20 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:29:20 user nova-compute[75026]:       <serial>58dcd553-406e-46b2-aea9-c3d72298d832</serial>
Nov 10 19:29:20 user nova-compute[75026]:     </disk>
Nov 10 19:29:20 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:29:20 user nova-compute[75026]:       <mac address="fa:16:3e:c5:2b:6b"/>
Nov 10 19:29:20 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:29:20 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:29:20 user nova-compute[75026]:       <target dev="tapbb533d1f-0b"/>
Nov 10 19:29:20 user nova-compute[75026]:     </interface>
Nov 10 19:29:20 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:29:20 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/b5d275d9-e5fe-425c-9dfb-270a989a6872/console.log" append="off"/>
Nov 10 19:29:20 user nova-compute[75026]:     </serial>
Nov 10 19:29:20 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:29:20 user nova-compute[75026]:     <video>
Nov 10 19:29:20 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:29:20 user nova-compute[75026]:     </video>
Nov 10 19:29:20 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:29:20 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:29:20 user nova-compute[75026]:     </rng>
Nov 10 19:29:20 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:29:20 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:29:20 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:29:20 user nova-compute[75026]:     </memballoon>
Nov 10 19:29:20 user nova-compute[75026]:   </devices>
Nov 10 19:29:20 user nova-compute[75026]: </domain>
Nov 10 19:29:20 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1064278232',display_name='tempest-TestShelveInstance-server-1064278232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1064278232',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIcG06meqhA5bz7nbSQbZnjNzSgJzS3zy+v9ArBM3fHe0Y+Lof0p4LlRhMVALo/dQrCRaepIdoB64mOCskZ5yShq/6cu+uotc8QF8do1Lx7g6WPDNmgW5lwgIq+YzbuWQ==',key_name='tempest-TestShelveInstance-380999352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6368f0d1abea492eb4b57d5243bb074d',ramdisk_id='',reservation_id='r-q11ebfki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-731674373',owner_user_name='tempest-TestShelveInstance-731674373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:28:52Z,user_data=None,user_id='c2431c27d25041fa91adb7e38b319682',uuid=b5d275d9-e5fe-425c-9dfb-270a989a6872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Converting VIF {"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2b:6b,bridge_name='br-int',has_traffic_filtering=True,id=bb533d1f-0b83-47a2-9592-34de09911b5f,network=Network(b7c41db0-c65b-448c-a432-39764644c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb533d1f-0b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG os_vif [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2b:6b,bridge_name='br-int',has_traffic_filtering=True,id=bb533d1f-0b83-47a2-9592-34de09911b5f,network=Network(b7c41db0-c65b-448c-a432-39764644c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb533d1f-0b') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb1b8920-96a1-5ad1-a5b4-2aae1b650d52', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb533d1f-0b, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb533d1f-0b, col_values=(('qos', UUID('8de020d7-d782-4bcd-be53-f8147490fd54')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb533d1f-0b, col_values=(('external_ids', {'iface-id': 'bb533d1f-0b83-47a2-9592-34de09911b5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:2b:6b', 'vm-uuid': 'b5d275d9-e5fe-425c-9dfb-270a989a6872'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:20 user nova-compute[75026]: INFO os_vif [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2b:6b,bridge_name='br-int',has_traffic_filtering=True,id=bb533d1f-0b83-47a2-9592-34de09911b5f,network=Network(b7c41db0-c65b-448c-a432-39764644c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb533d1f-0b')
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:29:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] No VIF found with MAC fa:16:3e:c5:2b:6b, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:29:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:29:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-e0d22055-189a-4eb1-9136-675aaf90c110 req-3731fe6e-5fef-43d8-a5bd-65418ec70732 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received event network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e0d22055-189a-4eb1-9136-675aaf90c110 req-3731fe6e-5fef-43d8-a5bd-65418ec70732 service nova] Acquiring lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e0d22055-189a-4eb1-9136-675aaf90c110 req-3731fe6e-5fef-43d8-a5bd-65418ec70732 service nova] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e0d22055-189a-4eb1-9136-675aaf90c110 req-3731fe6e-5fef-43d8-a5bd-65418ec70732 service nova] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-e0d22055-189a-4eb1-9136-675aaf90c110 req-3731fe6e-5fef-43d8-a5bd-65418ec70732 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] No waiting events found dispatching network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:22 user nova-compute[75026]: WARNING nova.compute.manager [req-e0d22055-189a-4eb1-9136-675aaf90c110 req-3731fe6e-5fef-43d8-a5bd-65418ec70732 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received unexpected event network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f for instance with vm_state building and task_state spawning.
Nov 10 19:29:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-741544d4-cbcd-4fb0-bf5c-861b4d60c8bf req-dd0e0621-1bab-4c95-9b7e-0f8dca562f29 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received event network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-741544d4-cbcd-4fb0-bf5c-861b4d60c8bf req-dd0e0621-1bab-4c95-9b7e-0f8dca562f29 service nova] Acquiring lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-741544d4-cbcd-4fb0-bf5c-861b4d60c8bf req-dd0e0621-1bab-4c95-9b7e-0f8dca562f29 service nova] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-741544d4-cbcd-4fb0-bf5c-861b4d60c8bf req-dd0e0621-1bab-4c95-9b7e-0f8dca562f29 service nova] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-741544d4-cbcd-4fb0-bf5c-861b4d60c8bf req-dd0e0621-1bab-4c95-9b7e-0f8dca562f29 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] No waiting events found dispatching network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:29:24 user nova-compute[75026]: WARNING nova.compute.manager [req-741544d4-cbcd-4fb0-bf5c-861b4d60c8bf req-dd0e0621-1bab-4c95-9b7e-0f8dca562f29 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received unexpected event network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f for instance with vm_state building and task_state spawning.
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:29:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Instance spawned successfully.
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:29:24 user nova-compute[75026]: INFO nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 10 19:29:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:29:24 user nova-compute[75026]: INFO nova.compute.manager [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Took 33.25 seconds to build instance.
Nov 10 19:29:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ae7ca2-124f-4c04-b7f2-eaafef3a6f0e tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.347s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-0a557911-9645-4ab6-9b9a-7a0d0eb2bc3c req-ef94f8e0-3a83-4050-b241-4cee843c4449 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-changed-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-0a557911-9645-4ab6-9b9a-7a0d0eb2bc3c req-ef94f8e0-3a83-4050-b241-4cee843c4449 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Refreshing instance network info cache due to event network-changed-b2b60a7f-6664-4ecd-8cf6-c4803546ee32. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:29:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0a557911-9645-4ab6-9b9a-7a0d0eb2bc3c req-ef94f8e0-3a83-4050-b241-4cee843c4449 service nova] Acquiring lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:29:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0a557911-9645-4ab6-9b9a-7a0d0eb2bc3c req-ef94f8e0-3a83-4050-b241-4cee843c4449 service nova] Acquired lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:29:28 user nova-compute[75026]: DEBUG nova.network.neutron [req-0a557911-9645-4ab6-9b9a-7a0d0eb2bc3c req-ef94f8e0-3a83-4050-b241-4cee843c4449 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Refreshing network info cache for port b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:29:29 user nova-compute[75026]: DEBUG nova.network.neutron [req-0a557911-9645-4ab6-9b9a-7a0d0eb2bc3c req-ef94f8e0-3a83-4050-b241-4cee843c4449 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updated VIF entry in instance network info cache for port b2b60a7f-6664-4ecd-8cf6-c4803546ee32. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:29:29 user nova-compute[75026]: DEBUG nova.network.neutron [req-0a557911-9645-4ab6-9b9a-7a0d0eb2bc3c req-ef94f8e0-3a83-4050-b241-4cee843c4449 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:29:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0a557911-9645-4ab6-9b9a-7a0d0eb2bc3c req-ef94f8e0-3a83-4050-b241-4cee843c4449 service nova] Releasing lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:29:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-b207c509-6628-49f4-b642-6c7e8b0bce53 req-b1555f0d-1649-4cd1-87bc-ff8e2b922133 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received event network-changed-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-b207c509-6628-49f4-b642-6c7e8b0bce53 req-b1555f0d-1649-4cd1-87bc-ff8e2b922133 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Refreshing instance network info cache due to event network-changed-e20e129d-37c2-469e-aac2-349d1f175fe8. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:29:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b207c509-6628-49f4-b642-6c7e8b0bce53 req-b1555f0d-1649-4cd1-87bc-ff8e2b922133 service nova] Acquiring lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:29:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b207c509-6628-49f4-b642-6c7e8b0bce53 req-b1555f0d-1649-4cd1-87bc-ff8e2b922133 service nova] Acquired lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:29:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-b207c509-6628-49f4-b642-6c7e8b0bce53 req-b1555f0d-1649-4cd1-87bc-ff8e2b922133 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Refreshing network info cache for port e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:29:31 user nova-compute[75026]: DEBUG nova.network.neutron [req-b207c509-6628-49f4-b642-6c7e8b0bce53 req-b1555f0d-1649-4cd1-87bc-ff8e2b922133 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Updated VIF entry in instance network info cache for port e20e129d-37c2-469e-aac2-349d1f175fe8. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:29:31 user nova-compute[75026]: DEBUG nova.network.neutron [req-b207c509-6628-49f4-b642-6c7e8b0bce53 req-b1555f0d-1649-4cd1-87bc-ff8e2b922133 service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Updating instance_info_cache with network_info: [{"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:29:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b207c509-6628-49f4-b642-6c7e8b0bce53 req-b1555f0d-1649-4cd1-87bc-ff8e2b922133 service nova] Releasing lock "refresh_cache-00fbb0b3-a888-4348-ad97-41aed258ff13" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:29:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:29:47 user nova-compute[75026]: INFO nova.compute.claims [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Claim successful on node user
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:29:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:29:47 user nova-compute[75026]: DEBUG nova.policy [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '758478b59f94467898696fa7af7cd630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e509e662d27146fba4f51fd55dbe6f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:29:47 user nova-compute[75026]: INFO nova.virt.block_device [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Booting with volume snapshot f3160c30-c95f-42cd-8e78-0390c4fa0748 at /dev/vda
Nov 10 19:29:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Successfully created port: d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:29:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Successfully updated port: d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquired lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-16660da3-528b-4b14-a26b-f9ad5ab8ea54 req-5acfd78b-78f9-4e51-a78e-37b8db71463a service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received event network-changed-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-16660da3-528b-4b14-a26b-f9ad5ab8ea54 req-5acfd78b-78f9-4e51-a78e-37b8db71463a service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Refreshing instance network info cache due to event network-changed-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16660da3-528b-4b14-a26b-f9ad5ab8ea54 req-5acfd78b-78f9-4e51-a78e-37b8db71463a service nova] Acquiring lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Updating instance_info_cache with network_info: [{"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Releasing lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Instance network_info: |[{"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16660da3-528b-4b14-a26b-f9ad5ab8ea54 req-5acfd78b-78f9-4e51-a78e-37b8db71463a service nova] Acquired lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:29:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-16660da3-528b-4b14-a26b-f9ad5ab8ea54 req-5acfd78b-78f9-4e51-a78e-37b8db71463a service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Refreshing network info cache for port d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:29:50 user nova-compute[75026]: DEBUG nova.network.neutron [req-16660da3-528b-4b14-a26b-f9ad5ab8ea54 req-5acfd78b-78f9-4e51-a78e-37b8db71463a service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Updated VIF entry in instance network info cache for port d59b6ce5-9f34-4796-b1b0-0d65ac4e6245. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:29:50 user nova-compute[75026]: DEBUG nova.network.neutron [req-16660da3-528b-4b14-a26b-f9ad5ab8ea54 req-5acfd78b-78f9-4e51-a78e-37b8db71463a service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Updating instance_info_cache with network_info: [{"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:29:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16660da3-528b-4b14-a26b-f9ad5ab8ea54 req-5acfd78b-78f9-4e51-a78e-37b8db71463a service nova] Releasing lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:29:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG os_brick.utils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0041cc-a9cd-4c85-b99e-6d45433bb788]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d748537-8fe4-45c8-90c8-2502a3d33fe4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[96622b7c-83c1-4619-82b7-63202ee53cee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8617f95-4b4c-49f3-addd-8d588abebbfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:29:58 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:29:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df0696-34df-41ec-90bb-7475f3fd9c05]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:29:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:29:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:29:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:29:59 user nova-compute[75026]: DEBUG os_brick.utils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:29:59 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Updating existing volume attachment record: cc091268-96fb-41b0-aef1-b1f89b5b77ca {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:30:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:30:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:30:11 user nova-compute[75026]: INFO nova.compute.claims [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Claim successful on node user
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.network.neutron [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:30:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.policy [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a44857fb02f843df95883ee2b5daf3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a491b667d34c4a9f991e2d7d29099671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:30:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Creating image(s)
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "/opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "/opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.205s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.208s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk 1073741824" returned: 0 in 0.064s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.205s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG nova.network.neutron [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Successfully created port: 1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Cannot resize image /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Ensure instance console log exists: /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Successfully updated port: 1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquired lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-a69de102-12a3-46df-beac-6fce80c660ac req-18c9d92f-5cdc-44af-9483-8890b9594bf4 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received event network-changed-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-a69de102-12a3-46df-beac-6fce80c660ac req-18c9d92f-5cdc-44af-9483-8890b9594bf4 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Refreshing instance network info cache due to event network-changed-1186dc92-705f-4f17-a32c-7129cfdc0a8f. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a69de102-12a3-46df-beac-6fce80c660ac req-18c9d92f-5cdc-44af-9483-8890b9594bf4 service nova] Acquiring lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Updating instance_info_cache with network_info: [{"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Releasing lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Instance network_info: |[{"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a69de102-12a3-46df-beac-6fce80c660ac req-18c9d92f-5cdc-44af-9483-8890b9594bf4 service nova] Acquired lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:30:13 user nova-compute[75026]: DEBUG nova.network.neutron [req-a69de102-12a3-46df-beac-6fce80c660ac req-18c9d92f-5cdc-44af-9483-8890b9594bf4 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Refreshing network info cache for port 1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Start _get_guest_xml network_info=[{"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:30:14 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:30:14 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162041140',display_name='tempest-AttachVolumeNegativeTest-server-1162041140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162041140',id=27,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwNLrBsfdzrB9MLlHXLqcwK/al2petPdIa7V9BCp/fQjFo3AzMHP9ggTjUX3+TD2XuKQD/f+Uy+y2+qgwikiNzUyVcmERVlDOgfIbfBms49x04vCPSgCFmC3zKKUrFiZA==',key_name='tempest-keypair-945191627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-99tv57je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=2f221451-f4c3-441d-8585-b0c41e18bd7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:30:14,bridge_name='br-int',has_traffic_filtering=True,id=1186dc92-705f-4f17-a32c-7129cfdc0a8f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1186dc92-70') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.objects.instance [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f221451-f4c3-441d-8585-b0c41e18bd7f {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:30:14 user nova-compute[75026]:   <uuid>2f221451-f4c3-441d-8585-b0c41e18bd7f</uuid>
Nov 10 19:30:14 user nova-compute[75026]:   <name>instance-0000001b</name>
Nov 10 19:30:14 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:30:14 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:30:14 user nova-compute[75026]:   <metadata>
Nov 10 19:30:14 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:30:14 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:30:14 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1162041140</nova:name>
Nov 10 19:30:14 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:30:14</nova:creationTime>
Nov 10 19:30:14 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:30:14 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:30:14 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:30:14 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:30:14 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:30:14 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:30:14 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:30:14 user nova-compute[75026]:       <nova:owner>
Nov 10 19:30:14 user nova-compute[75026]:         <nova:user uuid="a44857fb02f843df95883ee2b5daf3ce">tempest-AttachVolumeNegativeTest-1780662801-project-member</nova:user>
Nov 10 19:30:14 user nova-compute[75026]:         <nova:project uuid="a491b667d34c4a9f991e2d7d29099671">tempest-AttachVolumeNegativeTest-1780662801</nova:project>
Nov 10 19:30:14 user nova-compute[75026]:       </nova:owner>
Nov 10 19:30:14 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:30:14 user nova-compute[75026]:       <nova:ports>
Nov 10 19:30:14 user nova-compute[75026]:         <nova:port uuid="1186dc92-705f-4f17-a32c-7129cfdc0a8f">
Nov 10 19:30:14 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:30:14 user nova-compute[75026]:         </nova:port>
Nov 10 19:30:14 user nova-compute[75026]:       </nova:ports>
Nov 10 19:30:14 user nova-compute[75026]:     </nova:instance>
Nov 10 19:30:14 user nova-compute[75026]:   </metadata>
Nov 10 19:30:14 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:30:14 user nova-compute[75026]:     <system>
Nov 10 19:30:14 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:30:14 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:30:14 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:30:14 user nova-compute[75026]:       <entry name="serial">2f221451-f4c3-441d-8585-b0c41e18bd7f</entry>
Nov 10 19:30:14 user nova-compute[75026]:       <entry name="uuid">2f221451-f4c3-441d-8585-b0c41e18bd7f</entry>
Nov 10 19:30:14 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:30:14 user nova-compute[75026]:     </system>
Nov 10 19:30:14 user nova-compute[75026]:   </sysinfo>
Nov 10 19:30:14 user nova-compute[75026]:   <os>
Nov 10 19:30:14 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:30:14 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:30:14 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:30:14 user nova-compute[75026]:   </os>
Nov 10 19:30:14 user nova-compute[75026]:   <features>
Nov 10 19:30:14 user nova-compute[75026]:     <acpi/>
Nov 10 19:30:14 user nova-compute[75026]:     <apic/>
Nov 10 19:30:14 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:30:14 user nova-compute[75026]:   </features>
Nov 10 19:30:14 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:30:14 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:30:14 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:30:14 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:30:14 user nova-compute[75026]:   </clock>
Nov 10 19:30:14 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:30:14 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:30:14 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:30:14 user nova-compute[75026]:   </cpu>
Nov 10 19:30:14 user nova-compute[75026]:   <devices>
Nov 10 19:30:14 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:30:14 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:30:14 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk"/>
Nov 10 19:30:14 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:30:14 user nova-compute[75026]:     </disk>
Nov 10 19:30:14 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:30:14 user nova-compute[75026]:       <mac address="fa:16:3e:85:30:14"/>
Nov 10 19:30:14 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:30:14 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:30:14 user nova-compute[75026]:       <target dev="tap1186dc92-70"/>
Nov 10 19:30:14 user nova-compute[75026]:     </interface>
Nov 10 19:30:14 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:30:14 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/console.log" append="off"/>
Nov 10 19:30:14 user nova-compute[75026]:     </serial>
Nov 10 19:30:14 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:30:14 user nova-compute[75026]:     <video>
Nov 10 19:30:14 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:30:14 user nova-compute[75026]:     </video>
Nov 10 19:30:14 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:30:14 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:30:14 user nova-compute[75026]:     </rng>
Nov 10 19:30:14 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:30:14 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:30:14 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:30:14 user nova-compute[75026]:     </memballoon>
Nov 10 19:30:14 user nova-compute[75026]:   </devices>
Nov 10 19:30:14 user nova-compute[75026]: </domain>
Nov 10 19:30:14 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162041140',display_name='tempest-AttachVolumeNegativeTest-server-1162041140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162041140',id=27,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwNLrBsfdzrB9MLlHXLqcwK/al2petPdIa7V9BCp/fQjFo3AzMHP9ggTjUX3+TD2XuKQD/f+Uy+y2+qgwikiNzUyVcmERVlDOgfIbfBms49x04vCPSgCFmC3zKKUrFiZA==',key_name='tempest-keypair-945191627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-99tv57je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=2f221451-f4c3-441d-8585-b0c41e18bd7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:30:14,bridge_name='br-int',has_traffic_filtering=True,id=1186dc92-705f-4f17-a32c-7129cfdc0a8f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1186dc92-70') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG os_vif [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:30:14,bridge_name='br-int',has_traffic_filtering=True,id=1186dc92-705f-4f17-a32c-7129cfdc0a8f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1186dc92-70') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '059fbcee-4a82-5b37-8561-87818ff7e93b', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1186dc92-70, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1186dc92-70, col_values=(('qos', UUID('558c6587-c578-4bd8-bbec-5435b515a17f')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1186dc92-70, col_values=(('external_ids', {'iface-id': '1186dc92-705f-4f17-a32c-7129cfdc0a8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:30:14', 'vm-uuid': '2f221451-f4c3-441d-8585-b0c41e18bd7f'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:14 user nova-compute[75026]: INFO os_vif [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:30:14,bridge_name='br-int',has_traffic_filtering=True,id=1186dc92-705f-4f17-a32c-7129cfdc0a8f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1186dc92-70')
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No VIF found with MAC fa:16:3e:85:30:14, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-a69de102-12a3-46df-beac-6fce80c660ac req-18c9d92f-5cdc-44af-9483-8890b9594bf4 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Updated VIF entry in instance network info cache for port 1186dc92-705f-4f17-a32c-7129cfdc0a8f. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-a69de102-12a3-46df-beac-6fce80c660ac req-18c9d92f-5cdc-44af-9483-8890b9594bf4 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Updating instance_info_cache with network_info: [{"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a69de102-12a3-46df-beac-6fce80c660ac req-18c9d92f-5cdc-44af-9483-8890b9594bf4 service nova] Releasing lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-b6117973-05ba-43e3-95e0-9b8573134ecb req-25afb325-6d61-4967-a801-3ffca4e7e1b3 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received event network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b6117973-05ba-43e3-95e0-9b8573134ecb req-25afb325-6d61-4967-a801-3ffca4e7e1b3 service nova] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b6117973-05ba-43e3-95e0-9b8573134ecb req-25afb325-6d61-4967-a801-3ffca4e7e1b3 service nova] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b6117973-05ba-43e3-95e0-9b8573134ecb req-25afb325-6d61-4967-a801-3ffca4e7e1b3 service nova] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-b6117973-05ba-43e3-95e0-9b8573134ecb req-25afb325-6d61-4967-a801-3ffca4e7e1b3 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] No waiting events found dispatching network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:30:15 user nova-compute[75026]: WARNING nova.compute.manager [req-b6117973-05ba-43e3-95e0-9b8573134ecb req-25afb325-6d61-4967-a801-3ffca4e7e1b3 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received unexpected event network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f for instance with vm_state building and task_state spawning.
Nov 10 19:30:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:17 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:30:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-8e4810ab-197d-4e51-a13d-5a40835cc93c req-36488ac9-2ca7-49c2-ba37-3833ab349598 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received event network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8e4810ab-197d-4e51-a13d-5a40835cc93c req-36488ac9-2ca7-49c2-ba37-3833ab349598 service nova] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8e4810ab-197d-4e51-a13d-5a40835cc93c req-36488ac9-2ca7-49c2-ba37-3833ab349598 service nova] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8e4810ab-197d-4e51-a13d-5a40835cc93c req-36488ac9-2ca7-49c2-ba37-3833ab349598 service nova] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-8e4810ab-197d-4e51-a13d-5a40835cc93c req-36488ac9-2ca7-49c2-ba37-3833ab349598 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] No waiting events found dispatching network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:30:18 user nova-compute[75026]: WARNING nova.compute.manager [req-8e4810ab-197d-4e51-a13d-5a40835cc93c req-36488ac9-2ca7-49c2-ba37-3833ab349598 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received unexpected event network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f for instance with vm_state building and task_state spawning.
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:30:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Instance spawned successfully.
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:18 user nova-compute[75026]: INFO nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 10 19:30:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:18 user nova-compute[75026]: INFO nova.compute.manager [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Took 7.05 seconds to build instance.
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1ce0703-8040-4610-91c7-2613dcbdfef3 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.161s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:30:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:30:20 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:30:20 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8080MB free_disk=25.59935760498047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 00fbb0b3-a888-4348-ad97-41aed258ff13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5a70279-1a95-4c83-8243-b3bcb06fdbee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2f221451-f4c3-441d-8585-b0c41e18bd7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:30:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:30:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:30:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:30:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Creating image(s)
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Ensure instance console log exists: /opt/stack/data/nova/instances/dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Start _get_guest_xml network_info=[{"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T19:29:32Z,direct_url=<?>,disk_format='qcow2',id=a859ed25-5bea-4896-842d-dda8e3156143,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-261095304',owner='e509e662d27146fba4f51fd55dbe6f83',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T19:29:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'cc091268-96fb-41b0-aef1-b1f89b5b77ca', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxcwYFhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed250541-ac31-42b4-ab02-53446a5135d6', 'serial': 'ed250541-ac31-42b4-ab02-53446a5135d6'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:30:25 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:30:25 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T19:29:32Z,direct_url=<?>,disk_format='qcow2',id=a859ed25-5bea-4896-842d-dda8e3156143,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-261095304',owner='e509e662d27146fba4f51fd55dbe6f83',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T19:29:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxcwYFhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:30:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:30:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:30:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:30:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:30:25 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4ed350-d89e-42fd-91a2-f55e4f73fd5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:30:25 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d968a4-b42e-4095-9ae9-dcbe55f11070]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6] added
Nov 10 19:30:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[93108555-812c-4a92-8b27-42daa27b83f0]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3011f8d-cc66-413c-956b-9c759bed0500]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxcwYFhp {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxcwYFhp" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e9cdfa-2496-4704-86cc-aed37c473864]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxcwYFhp'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc414d0a-4928-4f27-8e8b-c0b2107769ff]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa6109a-be27-4543-b42e-d091e857a713]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:26 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:26 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f9d9e7-4dd6-41a6-9c30-8ab29c675c71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6, portal: 172.16.0.220,3260]
Nov 10 19:30:26 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6, portal: 172.16.0.220,3260] successful.
Nov 10 19:30:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c4d832-fe7f-4034-84d3-e56418c05909]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e11089-38ab-4758-955f-e4e91d89304c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:26 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:26 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:30:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:26 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:26 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:30:26 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[11212c3b-5d89-4cde-b17f-614c11c7aa06]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:30:26 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxcwYFhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26134383338363161', 'path': '/dev/sdd'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134383338363161', 'path': '/dev/sdd'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1277005512',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1277005512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1277005512',id=26,image_ref='a859ed25-5bea-4896-842d-dda8e3156143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaw5Ryk/y2y51FTGuDHktE1iXyDyYhtxYBQAGapLa6p4+sZMSov4cgqwAHHEFogbriBug5dsrZnDiTsXeKN+osub1HbS3vfxM4pGaaB71hzxwRtJkLeIIftGe5zlSmvHw==',key_name='tempest-keypair-1896878577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-2gouvyb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1182723443',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758478b59f94467898696fa7af7cd630',uuid=dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:06,bridge_name='br-int',has_traffic_filtering=True,id=d59b6ce5-9f34-4796-b1b0-0d65ac4e6245,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59b6ce5-9f') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.objects.instance [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'pci_devices' on Instance uuid dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:30:27 user nova-compute[75026]:   <uuid>dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b</uuid>
Nov 10 19:30:27 user nova-compute[75026]:   <name>instance-0000001a</name>
Nov 10 19:30:27 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:30:27 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:30:27 user nova-compute[75026]:   <metadata>
Nov 10 19:30:27 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:30:27 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:30:27 user nova-compute[75026]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1277005512</nova:name>
Nov 10 19:30:27 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:30:25</nova:creationTime>
Nov 10 19:30:27 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:30:27 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:30:27 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:30:27 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:30:27 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:30:27 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:30:27 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:30:27 user nova-compute[75026]:       <nova:owner>
Nov 10 19:30:27 user nova-compute[75026]:         <nova:user uuid="758478b59f94467898696fa7af7cd630">tempest-TestVolumeBootPattern-1182723443-project-member</nova:user>
Nov 10 19:30:27 user nova-compute[75026]:         <nova:project uuid="e509e662d27146fba4f51fd55dbe6f83">tempest-TestVolumeBootPattern-1182723443</nova:project>
Nov 10 19:30:27 user nova-compute[75026]:       </nova:owner>
Nov 10 19:30:27 user nova-compute[75026]:       <nova:root type="image" uuid="a859ed25-5bea-4896-842d-dda8e3156143"/>
Nov 10 19:30:27 user nova-compute[75026]:       <nova:ports>
Nov 10 19:30:27 user nova-compute[75026]:         <nova:port uuid="d59b6ce5-9f34-4796-b1b0-0d65ac4e6245">
Nov 10 19:30:27 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 19:30:27 user nova-compute[75026]:         </nova:port>
Nov 10 19:30:27 user nova-compute[75026]:       </nova:ports>
Nov 10 19:30:27 user nova-compute[75026]:     </nova:instance>
Nov 10 19:30:27 user nova-compute[75026]:   </metadata>
Nov 10 19:30:27 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:30:27 user nova-compute[75026]:     <system>
Nov 10 19:30:27 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:30:27 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:30:27 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:30:27 user nova-compute[75026]:       <entry name="serial">dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b</entry>
Nov 10 19:30:27 user nova-compute[75026]:       <entry name="uuid">dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b</entry>
Nov 10 19:30:27 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:30:27 user nova-compute[75026]:     </system>
Nov 10 19:30:27 user nova-compute[75026]:   </sysinfo>
Nov 10 19:30:27 user nova-compute[75026]:   <os>
Nov 10 19:30:27 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:30:27 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:30:27 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:30:27 user nova-compute[75026]:   </os>
Nov 10 19:30:27 user nova-compute[75026]:   <features>
Nov 10 19:30:27 user nova-compute[75026]:     <acpi/>
Nov 10 19:30:27 user nova-compute[75026]:     <apic/>
Nov 10 19:30:27 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:30:27 user nova-compute[75026]:   </features>
Nov 10 19:30:27 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:30:27 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:30:27 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:30:27 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:30:27 user nova-compute[75026]:   </clock>
Nov 10 19:30:27 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:30:27 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:30:27 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:30:27 user nova-compute[75026]:   </cpu>
Nov 10 19:30:27 user nova-compute[75026]:   <devices>
Nov 10 19:30:27 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:30:27 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:30:27 user nova-compute[75026]:       <source dev="/dev/sdd"/>
Nov 10 19:30:27 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:30:27 user nova-compute[75026]:       <serial>ed250541-ac31-42b4-ab02-53446a5135d6</serial>
Nov 10 19:30:27 user nova-compute[75026]:     </disk>
Nov 10 19:30:27 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:30:27 user nova-compute[75026]:       <mac address="fa:16:3e:36:70:06"/>
Nov 10 19:30:27 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:30:27 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:30:27 user nova-compute[75026]:       <target dev="tapd59b6ce5-9f"/>
Nov 10 19:30:27 user nova-compute[75026]:     </interface>
Nov 10 19:30:27 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:30:27 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b/console.log" append="off"/>
Nov 10 19:30:27 user nova-compute[75026]:     </serial>
Nov 10 19:30:27 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:30:27 user nova-compute[75026]:     <video>
Nov 10 19:30:27 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:30:27 user nova-compute[75026]:     </video>
Nov 10 19:30:27 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:30:27 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:30:27 user nova-compute[75026]:     </rng>
Nov 10 19:30:27 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:30:27 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:30:27 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:30:27 user nova-compute[75026]:     </memballoon>
Nov 10 19:30:27 user nova-compute[75026]:   </devices>
Nov 10 19:30:27 user nova-compute[75026]: </domain>
Nov 10 19:30:27 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1277005512',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1277005512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1277005512',id=26,image_ref='a859ed25-5bea-4896-842d-dda8e3156143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaw5Ryk/y2y51FTGuDHktE1iXyDyYhtxYBQAGapLa6p4+sZMSov4cgqwAHHEFogbriBug5dsrZnDiTsXeKN+osub1HbS3vfxM4pGaaB71hzxwRtJkLeIIftGe5zlSmvHw==',key_name='tempest-keypair-1896878577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-2gouvyb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1182723443',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758478b59f94467898696fa7af7cd630',uuid=dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:06,bridge_name='br-int',has_traffic_filtering=True,id=d59b6ce5-9f34-4796-b1b0-0d65ac4e6245,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59b6ce5-9f') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG os_vif [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:06,bridge_name='br-int',has_traffic_filtering=True,id=d59b6ce5-9f34-4796-b1b0-0d65ac4e6245,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59b6ce5-9f') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '832e8bb6-20f0-5cbe-bc3b-b1c83f45fe05', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd59b6ce5-9f, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd59b6ce5-9f, col_values=(('qos', UUID('0a2d0d7a-7193-4259-ab5e-a717b7b0d355')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd59b6ce5-9f, col_values=(('external_ids', {'iface-id': 'd59b6ce5-9f34-4796-b1b0-0d65ac4e6245', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:70:06', 'vm-uuid': 'dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:27 user nova-compute[75026]: INFO os_vif [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:06,bridge_name='br-int',has_traffic_filtering=True,id=d59b6ce5-9f34-4796-b1b0-0d65ac4e6245,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59b6ce5-9f')
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:30:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No VIF found with MAC fa:16:3e:36:70:06, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:30:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-b1514f7e-e806-40d9-8e80-58746358c90e req-d4a023fa-6fb2-4aa3-a7dc-9d955d13746a service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received event network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b1514f7e-e806-40d9-8e80-58746358c90e req-d4a023fa-6fb2-4aa3-a7dc-9d955d13746a service nova] Acquiring lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b1514f7e-e806-40d9-8e80-58746358c90e req-d4a023fa-6fb2-4aa3-a7dc-9d955d13746a service nova] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b1514f7e-e806-40d9-8e80-58746358c90e req-d4a023fa-6fb2-4aa3-a7dc-9d955d13746a service nova] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-b1514f7e-e806-40d9-8e80-58746358c90e req-d4a023fa-6fb2-4aa3-a7dc-9d955d13746a service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] No waiting events found dispatching network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:30:29 user nova-compute[75026]: WARNING nova.compute.manager [req-b1514f7e-e806-40d9-8e80-58746358c90e req-d4a023fa-6fb2-4aa3-a7dc-9d955d13746a service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received unexpected event network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 for instance with vm_state building and task_state spawning.
Nov 10 19:30:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-41a6b322-a7d2-46e2-820e-9a38c6fa4dbf req-94fb9348-c8ad-4287-b569-b1c3c2eac91f service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received event network-changed-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-41a6b322-a7d2-46e2-820e-9a38c6fa4dbf req-94fb9348-c8ad-4287-b569-b1c3c2eac91f service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Refreshing instance network info cache due to event network-changed-22634108-429f-42b5-ab70-28176c1b589a. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-41a6b322-a7d2-46e2-820e-9a38c6fa4dbf req-94fb9348-c8ad-4287-b569-b1c3c2eac91f service nova] Acquiring lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-41a6b322-a7d2-46e2-820e-9a38c6fa4dbf req-94fb9348-c8ad-4287-b569-b1c3c2eac91f service nova] Acquired lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:30:29 user nova-compute[75026]: DEBUG nova.network.neutron [req-41a6b322-a7d2-46e2-820e-9a38c6fa4dbf req-94fb9348-c8ad-4287-b569-b1c3c2eac91f service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Refreshing network info cache for port 22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:30:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-41a6b322-a7d2-46e2-820e-9a38c6fa4dbf req-94fb9348-c8ad-4287-b569-b1c3c2eac91f service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updated VIF entry in instance network info cache for port 22634108-429f-42b5-ab70-28176c1b589a. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:30:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-41a6b322-a7d2-46e2-820e-9a38c6fa4dbf req-94fb9348-c8ad-4287-b569-b1c3c2eac91f service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updating instance_info_cache with network_info: [{"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:30:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-41a6b322-a7d2-46e2-820e-9a38c6fa4dbf req-94fb9348-c8ad-4287-b569-b1c3c2eac91f service nova] Releasing lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-759580c0-3816-4496-8abd-748a5a86e182 req-52e4955c-066a-4487-8b9a-df87822c4f58 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received event network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-759580c0-3816-4496-8abd-748a5a86e182 req-52e4955c-066a-4487-8b9a-df87822c4f58 service nova] Acquiring lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-759580c0-3816-4496-8abd-748a5a86e182 req-52e4955c-066a-4487-8b9a-df87822c4f58 service nova] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-759580c0-3816-4496-8abd-748a5a86e182 req-52e4955c-066a-4487-8b9a-df87822c4f58 service nova] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-759580c0-3816-4496-8abd-748a5a86e182 req-52e4955c-066a-4487-8b9a-df87822c4f58 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] No waiting events found dispatching network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:30:31 user nova-compute[75026]: WARNING nova.compute.manager [req-759580c0-3816-4496-8abd-748a5a86e182 req-52e4955c-066a-4487-8b9a-df87822c4f58 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received unexpected event network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 for instance with vm_state building and task_state spawning.
Nov 10 19:30:31 user nova-compute[75026]: INFO nova.compute.manager [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] instance snapshotting
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:30:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Instance spawned successfully.
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Beginning live snapshot process
Nov 10 19:30:31 user nova-compute[75026]: INFO nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 10 19:30:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:30:31 user nova-compute[75026]: INFO nova.compute.manager [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Took 44.02 seconds to build instance.
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-96ff41bc-1567-4664-a9cb-b2c39ae251ed tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.150s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json -f qcow2 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json -f qcow2 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json -f qcow2" returned: 0 in 0.269s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.203s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdgsmgofr/426ae781714c467183e4e0fac410dccf.delta 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdgsmgofr/426ae781714c467183e4e0fac410dccf.delta 1073741824" returned: 0 in 0.057s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:32 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 19:30:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:30:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:30:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 19:30:33 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:30:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdgsmgofr/426ae781714c467183e4e0fac410dccf.delta /opt/stack/data/nova/instances/snapshots/tmpdgsmgofr/426ae781714c467183e4e0fac410dccf {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdgsmgofr/426ae781714c467183e4e0fac410dccf.delta /opt/stack/data/nova/instances/snapshots/tmpdgsmgofr/426ae781714c467183e4e0fac410dccf" returned: 0 in 0.338s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Snapshot extracted, beginning image upload
Nov 10 19:30:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Snapshot image upload complete
Nov 10 19:30:36 user nova-compute[75026]: INFO nova.compute.manager [None req-4e42cb3f-e84e-4482-aec3-5b958f8406c4 tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Took 5.72 seconds to snapshot the instance on the hypervisor.
Nov 10 19:30:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:30:38 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Creating image(s)
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Ensure instance console log exists: /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Start _get_guest_xml network_info=[{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '64363ef4-a864-433c-9e62-71ff664cd414', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnezwMif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b2146ef-84d2-4180-bea1-e0df77c56804', 'attached_at': '', 'detached_at': '', 'volume_id': '36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'serial': '36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:30:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:30:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnezwMif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:30:38 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:30:38 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:30:38 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ddaab-d7ae-4099-a9d8-40729d6e9489]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:30:38 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fb0fc6-f904-4ca6-9cf4-853c1320e991]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4] added
Nov 10 19:30:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e550e47f-62ee-4276-92a2-1c44f9a222a7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd395f94-ded6-4fe7-a5f2-76790277715a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vnezwMif {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vnezwMif" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e0ef5-8ddf-4c41-bea8-e3610698d2a1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vnezwMif'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea463715-e440-4733-9a7f-ab4b6fcbe492]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f32d156-4b9d-4d9a-ac2a-481c1834a5e4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bdc54f-7ef0-4253-9729-3a1c3aecf3c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4, portal: 172.16.0.220,3260]
Nov 10 19:30:38 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4, portal: 172.16.0.220,3260] successful.
Nov 10 19:30:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8888fbf2-fe54-433d-81d3-1d5416ab327d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2231c2b3-c35b-44fe-b61b-3cb167377fe2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:30:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[629a51aa-0828-4d93-b60b-2e3d415250da]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:30:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnezwMif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23565303431373830', 'path': '/dev/sde'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565303431373830', 'path': '/dev/sde'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-356811107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-356811107',id=23,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-ll4c8m2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:28:33Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=3b2146ef-84d2-4180-bea1-e0df77c56804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:af:dc,bridge_name='br-int',has_traffic_filtering=True,id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927b3f92-a9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:30:39 user nova-compute[75026]:   <uuid>3b2146ef-84d2-4180-bea1-e0df77c56804</uuid>
Nov 10 19:30:39 user nova-compute[75026]:   <name>instance-00000017</name>
Nov 10 19:30:39 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:30:39 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:30:39 user nova-compute[75026]:   <metadata>
Nov 10 19:30:39 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:30:39 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:30:39 user nova-compute[75026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-356811107</nova:name>
Nov 10 19:30:39 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:30:38</nova:creationTime>
Nov 10 19:30:39 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:30:39 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:30:39 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:30:39 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:30:39 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:30:39 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:30:39 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:30:39 user nova-compute[75026]:       <nova:owner>
Nov 10 19:30:39 user nova-compute[75026]:         <nova:user uuid="fcbd2be26ec84b5d9f6f6638963e870e">tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member</nova:user>
Nov 10 19:30:39 user nova-compute[75026]:         <nova:project uuid="43e468483e8f4f70bd228ff8194d76b7">tempest-ServerBootFromVolumeStableRescueTest-1118157225</nova:project>
Nov 10 19:30:39 user nova-compute[75026]:       </nova:owner>
Nov 10 19:30:39 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:30:39 user nova-compute[75026]:       <nova:ports>
Nov 10 19:30:39 user nova-compute[75026]:         <nova:port uuid="927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e">
Nov 10 19:30:39 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 19:30:39 user nova-compute[75026]:         </nova:port>
Nov 10 19:30:39 user nova-compute[75026]:       </nova:ports>
Nov 10 19:30:39 user nova-compute[75026]:     </nova:instance>
Nov 10 19:30:39 user nova-compute[75026]:   </metadata>
Nov 10 19:30:39 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:30:39 user nova-compute[75026]:     <system>
Nov 10 19:30:39 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:30:39 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:30:39 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:30:39 user nova-compute[75026]:       <entry name="serial">3b2146ef-84d2-4180-bea1-e0df77c56804</entry>
Nov 10 19:30:39 user nova-compute[75026]:       <entry name="uuid">3b2146ef-84d2-4180-bea1-e0df77c56804</entry>
Nov 10 19:30:39 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:30:39 user nova-compute[75026]:     </system>
Nov 10 19:30:39 user nova-compute[75026]:   </sysinfo>
Nov 10 19:30:39 user nova-compute[75026]:   <os>
Nov 10 19:30:39 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:30:39 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:30:39 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:30:39 user nova-compute[75026]:   </os>
Nov 10 19:30:39 user nova-compute[75026]:   <features>
Nov 10 19:30:39 user nova-compute[75026]:     <acpi/>
Nov 10 19:30:39 user nova-compute[75026]:     <apic/>
Nov 10 19:30:39 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:30:39 user nova-compute[75026]:   </features>
Nov 10 19:30:39 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:30:39 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:30:39 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:30:39 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:30:39 user nova-compute[75026]:   </clock>
Nov 10 19:30:39 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:30:39 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:30:39 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:30:39 user nova-compute[75026]:   </cpu>
Nov 10 19:30:39 user nova-compute[75026]:   <devices>
Nov 10 19:30:39 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:30:39 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:30:39 user nova-compute[75026]:       <source dev="/dev/sde"/>
Nov 10 19:30:39 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:30:39 user nova-compute[75026]:       <serial>36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4</serial>
Nov 10 19:30:39 user nova-compute[75026]:     </disk>
Nov 10 19:30:39 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:30:39 user nova-compute[75026]:       <mac address="fa:16:3e:fe:af:dc"/>
Nov 10 19:30:39 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:30:39 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:30:39 user nova-compute[75026]:       <target dev="tap927b3f92-a9"/>
Nov 10 19:30:39 user nova-compute[75026]:     </interface>
Nov 10 19:30:39 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:30:39 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/console.log" append="off"/>
Nov 10 19:30:39 user nova-compute[75026]:     </serial>
Nov 10 19:30:39 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:30:39 user nova-compute[75026]:     <video>
Nov 10 19:30:39 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:30:39 user nova-compute[75026]:     </video>
Nov 10 19:30:39 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:30:39 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:30:39 user nova-compute[75026]:     </rng>
Nov 10 19:30:39 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:30:39 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:30:39 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:30:39 user nova-compute[75026]:     </memballoon>
Nov 10 19:30:39 user nova-compute[75026]:   </devices>
Nov 10 19:30:39 user nova-compute[75026]: </domain>
Nov 10 19:30:39 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-356811107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-356811107',id=23,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-ll4c8m2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:28:33Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=3b2146ef-84d2-4180-bea1-e0df77c56804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:af:dc,bridge_name='br-int',has_traffic_filtering=True,id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927b3f92-a9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG os_vif [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:af:dc,bridge_name='br-int',has_traffic_filtering=True,id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927b3f92-a9') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00e2a866-086b-5706-bafa-9c68df648af5', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap927b3f92-a9, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap927b3f92-a9, col_values=(('qos', UUID('9422e998-914d-494c-abae-843e438a0e70')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap927b3f92-a9, col_values=(('external_ids', {'iface-id': '927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:af:dc', 'vm-uuid': '3b2146ef-84d2-4180-bea1-e0df77c56804'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:39 user nova-compute[75026]: INFO os_vif [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:af:dc,bridge_name='br-int',has_traffic_filtering=True,id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927b3f92-a9')
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:30:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No VIF found with MAC fa:16:3e:fe:af:dc, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:30:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-4af18423-a28e-4b0e-94b0-1f334a78f044 req-0807a3d4-a92c-4690-833e-114ade2f811c service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4af18423-a28e-4b0e-94b0-1f334a78f044 req-0807a3d4-a92c-4690-833e-114ade2f811c service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4af18423-a28e-4b0e-94b0-1f334a78f044 req-0807a3d4-a92c-4690-833e-114ade2f811c service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4af18423-a28e-4b0e-94b0-1f334a78f044 req-0807a3d4-a92c-4690-833e-114ade2f811c service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-4af18423-a28e-4b0e-94b0-1f334a78f044 req-0807a3d4-a92c-4690-833e-114ade2f811c service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:30:41 user nova-compute[75026]: WARNING nova.compute.manager [req-4af18423-a28e-4b0e-94b0-1f334a78f044 req-0807a3d4-a92c-4690-833e-114ade2f811c service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state building and task_state spawning.
Nov 10 19:30:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-04ed9c49-24fb-48ed-8d81-405a92cef673 req-a5c2cf6b-8b42-4a05-95ab-f63b807918f1 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04ed9c49-24fb-48ed-8d81-405a92cef673 req-a5c2cf6b-8b42-4a05-95ab-f63b807918f1 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04ed9c49-24fb-48ed-8d81-405a92cef673 req-a5c2cf6b-8b42-4a05-95ab-f63b807918f1 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04ed9c49-24fb-48ed-8d81-405a92cef673 req-a5c2cf6b-8b42-4a05-95ab-f63b807918f1 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-04ed9c49-24fb-48ed-8d81-405a92cef673 req-a5c2cf6b-8b42-4a05-95ab-f63b807918f1 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:30:43 user nova-compute[75026]: WARNING nova.compute.manager [req-04ed9c49-24fb-48ed-8d81-405a92cef673 req-a5c2cf6b-8b42-4a05-95ab-f63b807918f1 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state building and task_state spawning.
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-98faf7ca-5bf9-409f-9eee-3ff53e2915f1 req-39c038a5-0729-4a4d-9b2d-8baead08906d service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received event network-changed-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-98faf7ca-5bf9-409f-9eee-3ff53e2915f1 req-39c038a5-0729-4a4d-9b2d-8baead08906d service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Refreshing instance network info cache due to event network-changed-bb533d1f-0b83-47a2-9592-34de09911b5f. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-98faf7ca-5bf9-409f-9eee-3ff53e2915f1 req-39c038a5-0729-4a4d-9b2d-8baead08906d service nova] Acquiring lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-98faf7ca-5bf9-409f-9eee-3ff53e2915f1 req-39c038a5-0729-4a4d-9b2d-8baead08906d service nova] Acquired lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-98faf7ca-5bf9-409f-9eee-3ff53e2915f1 req-39c038a5-0729-4a4d-9b2d-8baead08906d service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Refreshing network info cache for port bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:30:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance spawned successfully.
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:43 user nova-compute[75026]: INFO nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:30:43 user nova-compute[75026]: INFO nova.compute.manager [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Took 131.85 seconds to build instance.
Nov 10 19:30:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7ac2582-c6d1-4ed3-8aff-42a358957895 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 132.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-98faf7ca-5bf9-409f-9eee-3ff53e2915f1 req-39c038a5-0729-4a4d-9b2d-8baead08906d service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updated VIF entry in instance network info cache for port bb533d1f-0b83-47a2-9592-34de09911b5f. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:30:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-98faf7ca-5bf9-409f-9eee-3ff53e2915f1 req-39c038a5-0729-4a4d-9b2d-8baead08906d service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updating instance_info_cache with network_info: [{"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-98faf7ca-5bf9-409f-9eee-3ff53e2915f1 req-39c038a5-0729-4a4d-9b2d-8baead08906d service nova] Releasing lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:44 user nova-compute[75026]: INFO nova.compute.manager [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Shelve offloading
Nov 10 19:30:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-28c5ae87-d325-4a3c-943f-620c8d14c59b req-b4f8806f-7755-4c32-8b46-972376e25744 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received event network-vif-unplugged-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28c5ae87-d325-4a3c-943f-620c8d14c59b req-b4f8806f-7755-4c32-8b46-972376e25744 service nova] Acquiring lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28c5ae87-d325-4a3c-943f-620c8d14c59b req-b4f8806f-7755-4c32-8b46-972376e25744 service nova] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28c5ae87-d325-4a3c-943f-620c8d14c59b req-b4f8806f-7755-4c32-8b46-972376e25744 service nova] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-28c5ae87-d325-4a3c-943f-620c8d14c59b req-b4f8806f-7755-4c32-8b46-972376e25744 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] No waiting events found dispatching network-vif-unplugged-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:30:44 user nova-compute[75026]: WARNING nova.compute.manager [req-28c5ae87-d325-4a3c-943f-620c8d14c59b req-b4f8806f-7755-4c32-8b46-972376e25744 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received unexpected event network-vif-unplugged-bb533d1f-0b83-47a2-9592-34de09911b5f for instance with vm_state active and task_state shelving.
Nov 10 19:30:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Instance destroyed successfully.
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquired lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updating instance_info_cache with network_info: [{"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Releasing lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:30:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Instance destroyed successfully.
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lazy-loading 'resources' on Instance uuid b5d275d9-e5fe-425c-9dfb-270a989a6872 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1064278232',display_name='tempest-TestShelveInstance-server-1064278232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1064278232',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIcG06meqhA5bz7nbSQbZnjNzSgJzS3zy+v9ArBM3fHe0Y+Lof0p4LlRhMVALo/dQrCRaepIdoB64mOCskZ5yShq/6cu+uotc8QF8do1Lx7g6WPDNmgW5lwgIq+YzbuWQ==',key_name='tempest-TestShelveInstance-380999352',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:29:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6368f0d1abea492eb4b57d5243bb074d',ramdisk_id='',reservation_id='r-q11ebfki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-731674373',owner_user_name='tempest-TestShelveInstance-731674373-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:29:25Z,user_data=None,user_id='c2431c27d25041fa91adb7e38b319682',uuid=b5d275d9-e5fe-425c-9dfb-270a989a6872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Converting VIF {"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": "br-int", "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": "bb533d1f-0b83-47a2-9592-34de09911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2b:6b,bridge_name='br-int',has_traffic_filtering=True,id=bb533d1f-0b83-47a2-9592-34de09911b5f,network=Network(b7c41db0-c65b-448c-a432-39764644c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb533d1f-0b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG os_vif [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2b:6b,bridge_name='br-int',has_traffic_filtering=True,id=bb533d1f-0b83-47a2-9592-34de09911b5f,network=Network(b7c41db0-c65b-448c-a432-39764644c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb533d1f-0b') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb533d1f-0b, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-669afd6c-d271-4254-8524-02bea9293610 req-17cbd236-26e7-4673-8eef-8e20d88ff329 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received event network-changed-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-669afd6c-d271-4254-8524-02bea9293610 req-17cbd236-26e7-4673-8eef-8e20d88ff329 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Refreshing instance network info cache due to event network-changed-bb533d1f-0b83-47a2-9592-34de09911b5f. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-669afd6c-d271-4254-8524-02bea9293610 req-17cbd236-26e7-4673-8eef-8e20d88ff329 service nova] Acquiring lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-669afd6c-d271-4254-8524-02bea9293610 req-17cbd236-26e7-4673-8eef-8e20d88ff329 service nova] Acquired lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.network.neutron [req-669afd6c-d271-4254-8524-02bea9293610 req-17cbd236-26e7-4673-8eef-8e20d88ff329 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Refreshing network info cache for port bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8de020d7-d782-4bcd-be53-f8147490fd54) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:45 user nova-compute[75026]: INFO os_vif [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2b:6b,bridge_name='br-int',has_traffic_filtering=True,id=bb533d1f-0b83-47a2-9592-34de09911b5f,network=Network(b7c41db0-c65b-448c-a432-39764644c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb533d1f-0b')
Nov 10 19:30:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DltiSprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:30:45 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:30:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:30:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8ac83d-12d3-48ac-add9-b446397485e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:30:46 user nova-compute[75026]: No targets found.
Nov 10 19:30:46 user nova-compute[75026]: iSNS:
Nov 10 19:30:46 user nova-compute[75026]: No targets found.
Nov 10 19:30:46 user nova-compute[75026]: STATIC:
Nov 10 19:30:46 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832
Nov 10 19:30:46 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:30:46 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:30:46 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6
Nov 10 19:30:46 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:30:46 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:30:46 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:30:46 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:30:46 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:30:46 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b
Nov 10 19:30:46 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:30:46 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:30:46 user nova-compute[75026]: FIRMWARE:
Nov 10 19:30:46 user nova-compute[75026]: No targets found.
Nov 10 19:30:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:30:46 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:30:46 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6f2719-1e95-44ca-aef1-1d8c2522c81f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60466f8f-6b85-476c-b414-cef19dd18b6a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:46 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:46 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:30:46 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:30:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:30:46 user nova-compute[75026]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 (non-flash)
Nov 10 19:30:46 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:30:46 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:30:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0259c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd529cf3-4167-41e7-8fdf-c7cfaea83693]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7715f035-70ec-4a4d-9e8a-dfe85319c4a9]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee06820-816a-4a5d-a31c-95c8904af8cf]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[766dd659-8617-4e59-9b8e-e0944c731899]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edcf146-701b-4496-b785-2016a8884194]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d5c907-bf23-4787-9594-3d9395e99c19]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832, portal: 172.16.0.220,3260]
Nov 10 19:30:46 user nova-compute[75026]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832, portal: 172.16.0.220,3260] successful.
Nov 10 19:30:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58dcd553-406e-46b2-aea9-c3d72298d832 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df8801-53d6-4f87-ad1f-cb74a30fd0d3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] <== disconnect_volume: return (354ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:30:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Deleting instance files /opt/stack/data/nova/instances/b5d275d9-e5fe-425c-9dfb-270a989a6872_del
Nov 10 19:30:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Deletion of /opt/stack/data/nova/instances/b5d275d9-e5fe-425c-9dfb-270a989a6872_del complete
Nov 10 19:30:46 user nova-compute[75026]: DEBUG nova.network.neutron [req-669afd6c-d271-4254-8524-02bea9293610 req-17cbd236-26e7-4673-8eef-8e20d88ff329 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updated VIF entry in instance network info cache for port bb533d1f-0b83-47a2-9592-34de09911b5f. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG nova.network.neutron [req-669afd6c-d271-4254-8524-02bea9293610 req-17cbd236-26e7-4673-8eef-8e20d88ff329 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updating instance_info_cache with network_info: [{"id": "bb533d1f-0b83-47a2-9592-34de09911b5f", "address": "fa:16:3e:c5:2b:6b", "network": {"id": "b7c41db0-c65b-448c-a432-39764644c394", "bridge": null, "label": "tempest-TestShelveInstance-780884695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6368f0d1abea492eb4b57d5243bb074d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbb533d1f-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-669afd6c-d271-4254-8524-02bea9293610 req-17cbd236-26e7-4673-8eef-8e20d88ff329 service nova] Releasing lock "refresh_cache-b5d275d9-e5fe-425c-9dfb-270a989a6872" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-60bcd532-4a23-406a-af06-6d8a104f69e4 req-7740d51b-e44a-43dc-aa01-60f5f3471c40 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received event network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-60bcd532-4a23-406a-af06-6d8a104f69e4 req-7740d51b-e44a-43dc-aa01-60f5f3471c40 service nova] Acquiring lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-60bcd532-4a23-406a-af06-6d8a104f69e4 req-7740d51b-e44a-43dc-aa01-60f5f3471c40 service nova] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-60bcd532-4a23-406a-af06-6d8a104f69e4 req-7740d51b-e44a-43dc-aa01-60f5f3471c40 service nova] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-60bcd532-4a23-406a-af06-6d8a104f69e4 req-7740d51b-e44a-43dc-aa01-60f5f3471c40 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] No waiting events found dispatching network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:30:46 user nova-compute[75026]: WARNING nova.compute.manager [req-60bcd532-4a23-406a-af06-6d8a104f69e4 req-7740d51b-e44a-43dc-aa01-60f5f3471c40 service nova] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Received unexpected event network-vif-plugged-bb533d1f-0b83-47a2-9592-34de09911b5f for instance with vm_state active and task_state shelving.
Nov 10 19:30:47 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Deleted allocations for instance b5d275d9-e5fe-425c-9dfb-270a989a6872
Nov 10 19:30:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:30:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:30:47 user nova-compute[75026]: DEBUG nova.objects.instance [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lazy-loading 'numa_topology' on Instance uuid b5d275d9-e5fe-425c-9dfb-270a989a6872 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:30:47 user nova-compute[75026]: DEBUG nova.objects.base [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Object Instance<b5d275d9-e5fe-425c-9dfb-270a989a6872> lazy-loaded attributes: resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:30:48 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:30:48 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:30:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-87af83ab-ceba-4cc5-a47e-d8aa3b3a4f4f tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.953s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:30:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:30:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:31:01 user nova-compute[75026]: INFO nova.compute.claims [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Claim successful on node user
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:31:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.policy [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f95e8bc5971d4c06b6755ad1f63c6856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50ae442a2faf4481a3fb87b1c7ea53bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:31:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:31:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Creating image(s)
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "/opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "/opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk 1073741824" returned: 0 in 0.058s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Successfully created port: f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Cannot resize image /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Ensure instance console log exists: /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Successfully updated port: f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquired lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-49ed81e0-7353-40b2-8735-598190da2a48 req-d738917a-a81d-4e8d-a053-cef598d0d11c service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received event network-changed-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-49ed81e0-7353-40b2-8735-598190da2a48 req-d738917a-a81d-4e8d-a053-cef598d0d11c service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Refreshing instance network info cache due to event network-changed-f4916190-3b62-43b2-a609-5671b8392ccc. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-49ed81e0-7353-40b2-8735-598190da2a48 req-d738917a-a81d-4e8d-a053-cef598d0d11c service nova] Acquiring lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Updating instance_info_cache with network_info: [{"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Releasing lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Instance network_info: |[{"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-49ed81e0-7353-40b2-8735-598190da2a48 req-d738917a-a81d-4e8d-a053-cef598d0d11c service nova] Acquired lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-49ed81e0-7353-40b2-8735-598190da2a48 req-d738917a-a81d-4e8d-a053-cef598d0d11c service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Refreshing network info cache for port f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Start _get_guest_xml network_info=[{"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:31:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:31:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1035596564',display_name='tempest-VolumesSnapshotTestJSON-instance-1035596564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1035596564',id=28,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs6Usy80yhL2/2dYReKOn8oyS5SsAtnL2yWJCnLjrq3WzVX6n5EFAJYrx/xxt9/fUebKYlc5tE1/kbppTTt/KZiUjcTDkrBGtWQeR35cyPCGoiL9R6Ow8BF6Yak5fIYzQ==',key_name='tempest-keypair-1559493376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ae442a2faf4481a3fb87b1c7ea53bf',ramdisk_id='',reservation_id='r-bea6p7yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1891642589',owner_user_name='tempest-VolumesSnapshotTestJSON-1891642589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f95e8bc5971d4c06b6755ad1f63c6856',uuid=ccbe3f6e-3b3b-4ca7-b784-2adf16555910,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converting VIF {"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:21:dd,bridge_name='br-int',has_traffic_filtering=True,id=f4916190-3b62-43b2-a609-5671b8392ccc,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4916190-3b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'pci_devices' on Instance uuid ccbe3f6e-3b3b-4ca7-b784-2adf16555910 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:31:03 user nova-compute[75026]:   <uuid>ccbe3f6e-3b3b-4ca7-b784-2adf16555910</uuid>
Nov 10 19:31:03 user nova-compute[75026]:   <name>instance-0000001c</name>
Nov 10 19:31:03 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:31:03 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:31:03 user nova-compute[75026]:   <metadata>
Nov 10 19:31:03 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:31:03 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:31:03 user nova-compute[75026]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1035596564</nova:name>
Nov 10 19:31:03 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:31:03</nova:creationTime>
Nov 10 19:31:03 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:31:03 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:31:03 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:31:03 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:31:03 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:31:03 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:31:03 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:31:03 user nova-compute[75026]:       <nova:owner>
Nov 10 19:31:03 user nova-compute[75026]:         <nova:user uuid="f95e8bc5971d4c06b6755ad1f63c6856">tempest-VolumesSnapshotTestJSON-1891642589-project-member</nova:user>
Nov 10 19:31:03 user nova-compute[75026]:         <nova:project uuid="50ae442a2faf4481a3fb87b1c7ea53bf">tempest-VolumesSnapshotTestJSON-1891642589</nova:project>
Nov 10 19:31:03 user nova-compute[75026]:       </nova:owner>
Nov 10 19:31:03 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:31:03 user nova-compute[75026]:       <nova:ports>
Nov 10 19:31:03 user nova-compute[75026]:         <nova:port uuid="f4916190-3b62-43b2-a609-5671b8392ccc">
Nov 10 19:31:03 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 19:31:03 user nova-compute[75026]:         </nova:port>
Nov 10 19:31:03 user nova-compute[75026]:       </nova:ports>
Nov 10 19:31:03 user nova-compute[75026]:     </nova:instance>
Nov 10 19:31:03 user nova-compute[75026]:   </metadata>
Nov 10 19:31:03 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:31:03 user nova-compute[75026]:     <system>
Nov 10 19:31:03 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:31:03 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:31:03 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:31:03 user nova-compute[75026]:       <entry name="serial">ccbe3f6e-3b3b-4ca7-b784-2adf16555910</entry>
Nov 10 19:31:03 user nova-compute[75026]:       <entry name="uuid">ccbe3f6e-3b3b-4ca7-b784-2adf16555910</entry>
Nov 10 19:31:03 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:31:03 user nova-compute[75026]:     </system>
Nov 10 19:31:03 user nova-compute[75026]:   </sysinfo>
Nov 10 19:31:03 user nova-compute[75026]:   <os>
Nov 10 19:31:03 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:31:03 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:31:03 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:31:03 user nova-compute[75026]:   </os>
Nov 10 19:31:03 user nova-compute[75026]:   <features>
Nov 10 19:31:03 user nova-compute[75026]:     <acpi/>
Nov 10 19:31:03 user nova-compute[75026]:     <apic/>
Nov 10 19:31:03 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:31:03 user nova-compute[75026]:   </features>
Nov 10 19:31:03 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:31:03 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:31:03 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:31:03 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:31:03 user nova-compute[75026]:   </clock>
Nov 10 19:31:03 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:31:03 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:31:03 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:31:03 user nova-compute[75026]:   </cpu>
Nov 10 19:31:03 user nova-compute[75026]:   <devices>
Nov 10 19:31:03 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:31:03 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:31:03 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk"/>
Nov 10 19:31:03 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:31:03 user nova-compute[75026]:     </disk>
Nov 10 19:31:03 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:31:03 user nova-compute[75026]:       <mac address="fa:16:3e:14:21:dd"/>
Nov 10 19:31:03 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:31:03 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:31:03 user nova-compute[75026]:       <target dev="tapf4916190-3b"/>
Nov 10 19:31:03 user nova-compute[75026]:     </interface>
Nov 10 19:31:03 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:31:03 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/console.log" append="off"/>
Nov 10 19:31:03 user nova-compute[75026]:     </serial>
Nov 10 19:31:03 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:31:03 user nova-compute[75026]:     <video>
Nov 10 19:31:03 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:31:03 user nova-compute[75026]:     </video>
Nov 10 19:31:03 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:31:03 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:31:03 user nova-compute[75026]:     </rng>
Nov 10 19:31:03 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:31:03 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:31:03 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:31:03 user nova-compute[75026]:     </memballoon>
Nov 10 19:31:03 user nova-compute[75026]:   </devices>
Nov 10 19:31:03 user nova-compute[75026]: </domain>
Nov 10 19:31:03 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1035596564',display_name='tempest-VolumesSnapshotTestJSON-instance-1035596564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1035596564',id=28,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs6Usy80yhL2/2dYReKOn8oyS5SsAtnL2yWJCnLjrq3WzVX6n5EFAJYrx/xxt9/fUebKYlc5tE1/kbppTTt/KZiUjcTDkrBGtWQeR35cyPCGoiL9R6Ow8BF6Yak5fIYzQ==',key_name='tempest-keypair-1559493376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50ae442a2faf4481a3fb87b1c7ea53bf',ramdisk_id='',reservation_id='r-bea6p7yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1891642589',owner_user_name='tempest-VolumesSnapshotTestJSON-1891642589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f95e8bc5971d4c06b6755ad1f63c6856',uuid=ccbe3f6e-3b3b-4ca7-b784-2adf16555910,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converting VIF {"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:21:dd,bridge_name='br-int',has_traffic_filtering=True,id=f4916190-3b62-43b2-a609-5671b8392ccc,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4916190-3b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG os_vif [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:21:dd,bridge_name='br-int',has_traffic_filtering=True,id=f4916190-3b62-43b2-a609-5671b8392ccc,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4916190-3b') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d591cbf-d684-5c56-aced-9f482cdb97a6', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4916190-3b, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4916190-3b, col_values=(('qos', UUID('a58dcad4-12ee-4e78-b422-1329cb3f75b8')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4916190-3b, col_values=(('external_ids', {'iface-id': 'f4916190-3b62-43b2-a609-5671b8392ccc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:21:dd', 'vm-uuid': 'ccbe3f6e-3b3b-4ca7-b784-2adf16555910'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:03 user nova-compute[75026]: INFO os_vif [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:21:dd,bridge_name='br-int',has_traffic_filtering=True,id=f4916190-3b62-43b2-a609-5671b8392ccc,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4916190-3b')
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No VIF found with MAC fa:16:3e:14:21:dd, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-49ed81e0-7353-40b2-8735-598190da2a48 req-d738917a-a81d-4e8d-a053-cef598d0d11c service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Updated VIF entry in instance network info cache for port f4916190-3b62-43b2-a609-5671b8392ccc. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-49ed81e0-7353-40b2-8735-598190da2a48 req-d738917a-a81d-4e8d-a053-cef598d0d11c service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Updating instance_info_cache with network_info: [{"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:31:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-49ed81e0-7353-40b2-8735-598190da2a48 req-d738917a-a81d-4e8d-a053-cef598d0d11c service nova] Releasing lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:31:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-13396e8f-6e23-48f1-a970-d9f181d61686 req-2b329457-de24-4d8c-95a7-6e7333dd3e4a service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received event network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-13396e8f-6e23-48f1-a970-d9f181d61686 req-2b329457-de24-4d8c-95a7-6e7333dd3e4a service nova] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-13396e8f-6e23-48f1-a970-d9f181d61686 req-2b329457-de24-4d8c-95a7-6e7333dd3e4a service nova] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-13396e8f-6e23-48f1-a970-d9f181d61686 req-2b329457-de24-4d8c-95a7-6e7333dd3e4a service nova] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-13396e8f-6e23-48f1-a970-d9f181d61686 req-2b329457-de24-4d8c-95a7-6e7333dd3e4a service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] No waiting events found dispatching network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:31:05 user nova-compute[75026]: WARNING nova.compute.manager [req-13396e8f-6e23-48f1-a970-d9f181d61686 req-2b329457-de24-4d8c-95a7-6e7333dd3e4a service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received unexpected event network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc for instance with vm_state building and task_state spawning.
Nov 10 19:31:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-5782652b-fc27-4a99-8c3e-2601bb9f6d77 req-dc065cef-387d-4cb2-8cdb-580c07fdd7d9 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received event network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5782652b-fc27-4a99-8c3e-2601bb9f6d77 req-dc065cef-387d-4cb2-8cdb-580c07fdd7d9 service nova] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5782652b-fc27-4a99-8c3e-2601bb9f6d77 req-dc065cef-387d-4cb2-8cdb-580c07fdd7d9 service nova] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5782652b-fc27-4a99-8c3e-2601bb9f6d77 req-dc065cef-387d-4cb2-8cdb-580c07fdd7d9 service nova] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-5782652b-fc27-4a99-8c3e-2601bb9f6d77 req-dc065cef-387d-4cb2-8cdb-580c07fdd7d9 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] No waiting events found dispatching network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:31:07 user nova-compute[75026]: WARNING nova.compute.manager [req-5782652b-fc27-4a99-8c3e-2601bb9f6d77 req-dc065cef-387d-4cb2-8cdb-580c07fdd7d9 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received unexpected event network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc for instance with vm_state building and task_state spawning.
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:31:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Instance spawned successfully.
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:07 user nova-compute[75026]: INFO nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 10 19:31:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:31:07 user nova-compute[75026]: INFO nova.compute.manager [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Took 6.28 seconds to build instance.
Nov 10 19:31:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2ab013fd-e4e9-4551-b505-f9a77247807c tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.394s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:13 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:31:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:31:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:31:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:31:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:31:13 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid b9e39b1a-3119-456e-b16d-192dbcd66ae3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:31:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updating instance_info_cache with network_info: [{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:31:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:31:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:31:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:31:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:31:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:31:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:31:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:31:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:31:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:31:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:22 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:31:22 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7825MB free_disk=25.50896453857422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 00fbb0b3-a888-4348-ad97-41aed258ff13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5a70279-1a95-4c83-8243-b3bcb06fdbee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2f221451-f4c3-441d-8585-b0c41e18bd7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:31:22 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:31:23 user nova-compute[75026]: INFO nova.compute.claims [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Claim successful on node user
Nov 10 19:31:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:31:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:31:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG nova.policy [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4fcc097fff34ad2b2cc532d269e06bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdef98b8144148229b82888b888d88c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:31:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Creating image(s)
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk 1073741824" returned: 0 in 0.051s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Successfully created port: fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:31:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.380s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Cannot resize image /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Ensure instance console log exists: /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Successfully updated port: fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquired lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.compute.manager [req-c8ccbade-3374-4e3a-aa9a-43194703a093 req-d8ab232f-4e5e-4924-b611-ef055ee0b2af service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-changed-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.compute.manager [req-c8ccbade-3374-4e3a-aa9a-43194703a093 req-d8ab232f-4e5e-4924-b611-ef055ee0b2af service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Refreshing instance network info cache due to event network-changed-fc38295a-d9ab-42e2-83c7-8623dc67f022. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8ccbade-3374-4e3a-aa9a-43194703a093 req-d8ab232f-4e5e-4924-b611-ef055ee0b2af service nova] Acquiring lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Updating instance_info_cache with network_info: [{"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Releasing lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance network_info: |[{"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8ccbade-3374-4e3a-aa9a-43194703a093 req-d8ab232f-4e5e-4924-b611-ef055ee0b2af service nova] Acquired lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:31:25 user nova-compute[75026]: DEBUG nova.network.neutron [req-c8ccbade-3374-4e3a-aa9a-43194703a093 req-d8ab232f-4e5e-4924-b611-ef055ee0b2af service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Refreshing network info cache for port fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Start _get_guest_xml network_info=[{"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:31:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:31:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-15317474',display_name='tempest-tempest.common.compute-instance-15317474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-15317474',id=29,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANKbmnJLhIy/JKEN3OUfXLEG+Pdi5x/Nbfoi2d/gtVja3l6VtbaoyIkgBlAg41imqPAl5Eg9ZNth0ngB2O9LrKDF6yeH1SbrpemISX9AjOc/LDw0Q1j8cyQSpAhDjhMLg==',key_name='tempest-keypair-614238469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-r30cb6r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=2a333e19-c760-441d-bb5a-392d1f25b7e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.objects.instance [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a333e19-c760-441d-bb5a-392d1f25b7e1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:31:26 user nova-compute[75026]:   <uuid>2a333e19-c760-441d-bb5a-392d1f25b7e1</uuid>
Nov 10 19:31:26 user nova-compute[75026]:   <name>instance-0000001d</name>
Nov 10 19:31:26 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:31:26 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:31:26 user nova-compute[75026]:   <metadata>
Nov 10 19:31:26 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:31:26 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:31:26 user nova-compute[75026]:       <nova:name>tempest-tempest.common.compute-instance-15317474</nova:name>
Nov 10 19:31:26 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:31:26</nova:creationTime>
Nov 10 19:31:26 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:31:26 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:31:26 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:31:26 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:31:26 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:31:26 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:31:26 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:31:26 user nova-compute[75026]:       <nova:owner>
Nov 10 19:31:26 user nova-compute[75026]:         <nova:user uuid="b4fcc097fff34ad2b2cc532d269e06bb">tempest-ServerActionsTestOtherA-664805234-project-member</nova:user>
Nov 10 19:31:26 user nova-compute[75026]:         <nova:project uuid="cdef98b8144148229b82888b888d88c5">tempest-ServerActionsTestOtherA-664805234</nova:project>
Nov 10 19:31:26 user nova-compute[75026]:       </nova:owner>
Nov 10 19:31:26 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:31:26 user nova-compute[75026]:       <nova:ports>
Nov 10 19:31:26 user nova-compute[75026]:         <nova:port uuid="fc38295a-d9ab-42e2-83c7-8623dc67f022">
Nov 10 19:31:26 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 19:31:26 user nova-compute[75026]:         </nova:port>
Nov 10 19:31:26 user nova-compute[75026]:       </nova:ports>
Nov 10 19:31:26 user nova-compute[75026]:     </nova:instance>
Nov 10 19:31:26 user nova-compute[75026]:   </metadata>
Nov 10 19:31:26 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:31:26 user nova-compute[75026]:     <system>
Nov 10 19:31:26 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:31:26 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:31:26 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:31:26 user nova-compute[75026]:       <entry name="serial">2a333e19-c760-441d-bb5a-392d1f25b7e1</entry>
Nov 10 19:31:26 user nova-compute[75026]:       <entry name="uuid">2a333e19-c760-441d-bb5a-392d1f25b7e1</entry>
Nov 10 19:31:26 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:31:26 user nova-compute[75026]:     </system>
Nov 10 19:31:26 user nova-compute[75026]:   </sysinfo>
Nov 10 19:31:26 user nova-compute[75026]:   <os>
Nov 10 19:31:26 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:31:26 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:31:26 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:31:26 user nova-compute[75026]:   </os>
Nov 10 19:31:26 user nova-compute[75026]:   <features>
Nov 10 19:31:26 user nova-compute[75026]:     <acpi/>
Nov 10 19:31:26 user nova-compute[75026]:     <apic/>
Nov 10 19:31:26 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:31:26 user nova-compute[75026]:   </features>
Nov 10 19:31:26 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:31:26 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:31:26 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:31:26 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:31:26 user nova-compute[75026]:   </clock>
Nov 10 19:31:26 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:31:26 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:31:26 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:31:26 user nova-compute[75026]:   </cpu>
Nov 10 19:31:26 user nova-compute[75026]:   <devices>
Nov 10 19:31:26 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:31:26 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:31:26 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk"/>
Nov 10 19:31:26 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:31:26 user nova-compute[75026]:     </disk>
Nov 10 19:31:26 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:31:26 user nova-compute[75026]:       <mac address="fa:16:3e:31:29:5a"/>
Nov 10 19:31:26 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:31:26 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:31:26 user nova-compute[75026]:       <target dev="tapfc38295a-d9"/>
Nov 10 19:31:26 user nova-compute[75026]:     </interface>
Nov 10 19:31:26 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:31:26 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/console.log" append="off"/>
Nov 10 19:31:26 user nova-compute[75026]:     </serial>
Nov 10 19:31:26 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:31:26 user nova-compute[75026]:     <video>
Nov 10 19:31:26 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:31:26 user nova-compute[75026]:     </video>
Nov 10 19:31:26 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:31:26 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:31:26 user nova-compute[75026]:     </rng>
Nov 10 19:31:26 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:31:26 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:31:26 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:31:26 user nova-compute[75026]:     </memballoon>
Nov 10 19:31:26 user nova-compute[75026]:   </devices>
Nov 10 19:31:26 user nova-compute[75026]: </domain>
Nov 10 19:31:26 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-15317474',display_name='tempest-tempest.common.compute-instance-15317474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-15317474',id=29,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANKbmnJLhIy/JKEN3OUfXLEG+Pdi5x/Nbfoi2d/gtVja3l6VtbaoyIkgBlAg41imqPAl5Eg9ZNth0ngB2O9LrKDF6yeH1SbrpemISX9AjOc/LDw0Q1j8cyQSpAhDjhMLg==',key_name='tempest-keypair-614238469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-r30cb6r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=2a333e19-c760-441d-bb5a-392d1f25b7e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG os_vif [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69d10d65-9e47-5f35-a546-de5595dcf7a7', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc38295a-d9, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc38295a-d9, col_values=(('qos', UUID('83bd6ed7-c4ae-4b06-971d-4fbf0081fdf3')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc38295a-d9, col_values=(('external_ids', {'iface-id': 'fc38295a-d9ab-42e2-83c7-8623dc67f022', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:29:5a', 'vm-uuid': '2a333e19-c760-441d-bb5a-392d1f25b7e1'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:26 user nova-compute[75026]: INFO os_vif [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9')
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No VIF found with MAC fa:16:3e:31:29:5a, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-c8ccbade-3374-4e3a-aa9a-43194703a093 req-d8ab232f-4e5e-4924-b611-ef055ee0b2af service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Updated VIF entry in instance network info cache for port fc38295a-d9ab-42e2-83c7-8623dc67f022. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-c8ccbade-3374-4e3a-aa9a-43194703a093 req-d8ab232f-4e5e-4924-b611-ef055ee0b2af service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Updating instance_info_cache with network_info: [{"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:31:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8ccbade-3374-4e3a-aa9a-43194703a093 req-d8ab232f-4e5e-4924-b611-ef055ee0b2af service nova] Releasing lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-91eea668-1175-4c58-89b8-8f06cf61392a req-40e7496e-667a-4c79-8cfb-581a48765ac4 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-91eea668-1175-4c58-89b8-8f06cf61392a req-40e7496e-667a-4c79-8cfb-581a48765ac4 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-91eea668-1175-4c58-89b8-8f06cf61392a req-40e7496e-667a-4c79-8cfb-581a48765ac4 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-91eea668-1175-4c58-89b8-8f06cf61392a req-40e7496e-667a-4c79-8cfb-581a48765ac4 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-91eea668-1175-4c58-89b8-8f06cf61392a req-40e7496e-667a-4c79-8cfb-581a48765ac4 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:31:27 user nova-compute[75026]: WARNING nova.compute.manager [req-91eea668-1175-4c58-89b8-8f06cf61392a req-40e7496e-667a-4c79-8cfb-581a48765ac4 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state building and task_state spawning.
Nov 10 19:31:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-28b4bfb7-c964-4adf-972c-99b9ea1b5511 req-f7e09763-1bfe-4a68-96ab-dbb0801809b3 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28b4bfb7-c964-4adf-972c-99b9ea1b5511 req-f7e09763-1bfe-4a68-96ab-dbb0801809b3 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28b4bfb7-c964-4adf-972c-99b9ea1b5511 req-f7e09763-1bfe-4a68-96ab-dbb0801809b3 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28b4bfb7-c964-4adf-972c-99b9ea1b5511 req-f7e09763-1bfe-4a68-96ab-dbb0801809b3 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-28b4bfb7-c964-4adf-972c-99b9ea1b5511 req-f7e09763-1bfe-4a68-96ab-dbb0801809b3 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:31:29 user nova-compute[75026]: WARNING nova.compute.manager [req-28b4bfb7-c964-4adf-972c-99b9ea1b5511 req-f7e09763-1bfe-4a68-96ab-dbb0801809b3 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state building and task_state spawning.
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:31:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance spawned successfully.
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:31:30 user nova-compute[75026]: INFO nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 10 19:31:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:31:30 user nova-compute[75026]: INFO nova.compute.manager [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Took 6.62 seconds to build instance.
Nov 10 19:31:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be110d5a-f83d-4a16-aaab-46742e77ece9 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.764s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-42a89c70-d1e6-415a-9fb7-ee8f5fb326b6 req-98cafcd8-f954-4bc1-be67-8d43a60c5c87 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received event network-changed-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-42a89c70-d1e6-415a-9fb7-ee8f5fb326b6 req-98cafcd8-f954-4bc1-be67-8d43a60c5c87 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Refreshing instance network info cache due to event network-changed-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:31:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-42a89c70-d1e6-415a-9fb7-ee8f5fb326b6 req-98cafcd8-f954-4bc1-be67-8d43a60c5c87 service nova] Acquiring lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:31:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-42a89c70-d1e6-415a-9fb7-ee8f5fb326b6 req-98cafcd8-f954-4bc1-be67-8d43a60c5c87 service nova] Acquired lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:31:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-42a89c70-d1e6-415a-9fb7-ee8f5fb326b6 req-98cafcd8-f954-4bc1-be67-8d43a60c5c87 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Refreshing network info cache for port d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:31:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-42a89c70-d1e6-415a-9fb7-ee8f5fb326b6 req-98cafcd8-f954-4bc1-be67-8d43a60c5c87 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Updated VIF entry in instance network info cache for port d59b6ce5-9f34-4796-b1b0-0d65ac4e6245. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:31:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-42a89c70-d1e6-415a-9fb7-ee8f5fb326b6 req-98cafcd8-f954-4bc1-be67-8d43a60c5c87 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Updating instance_info_cache with network_info: [{"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-42a89c70-d1e6-415a-9fb7-ee8f5fb326b6 req-98cafcd8-f954-4bc1-be67-8d43a60c5c87 service nova] Releasing lock "refresh_cache-dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:39 user nova-compute[75026]: INFO nova.compute.manager [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Terminating instance
Nov 10 19:31:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Instance destroyed successfully.
Nov 10 19:31:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'resources' on Instance uuid dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1277005512',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1277005512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1277005512',id=26,image_ref='a859ed25-5bea-4896-842d-dda8e3156143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaw5Ryk/y2y51FTGuDHktE1iXyDyYhtxYBQAGapLa6p4+sZMSov4cgqwAHHEFogbriBug5dsrZnDiTsXeKN+osub1HbS3vfxM4pGaaB71hzxwRtJkLeIIftGe5zlSmvHw==',key_name='tempest-keypair-1896878577',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-2gouvyb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1182723443',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:30:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758478b59f94467898696fa7af7cd630',uuid=dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "address": "fa:16:3e:36:70:06", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59b6ce5-9f", "ovs_interfaceid": "d59b6ce5-9f34-4796-b1b0-0d65ac4e6245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:06,bridge_name='br-int',has_traffic_filtering=True,id=d59b6ce5-9f34-4796-b1b0-0d65ac4e6245,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59b6ce5-9f') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_vif [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:06,bridge_name='br-int',has_traffic_filtering=True,id=d59b6ce5-9f34-4796-b1b0-0d65ac4e6245,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59b6ce5-9f') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd59b6ce5-9f, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a2d0d7a-7193-4259-ab5e-a717b7b0d355) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:31:39 user nova-compute[75026]: INFO os_vif [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:70:06,bridge_name='br-int',has_traffic_filtering=True,id=d59b6ce5-9f34-4796-b1b0-0d65ac4e6245,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59b6ce5-9f')
Nov 10 19:31:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxcwYFhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:31:39 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[571221b4-eb85-498c-9ec4-35df8b88c95d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:31:39 user nova-compute[75026]: No targets found.
Nov 10 19:31:39 user nova-compute[75026]: iSNS:
Nov 10 19:31:39 user nova-compute[75026]: No targets found.
Nov 10 19:31:39 user nova-compute[75026]: STATIC:
Nov 10 19:31:39 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6
Nov 10 19:31:39 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:31:39 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:31:39 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:31:39 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:31:39 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:31:39 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b
Nov 10 19:31:39 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:31:39 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:31:39 user nova-compute[75026]: FIRMWARE:
Nov 10 19:31:39 user nova-compute[75026]: No targets found.
Nov 10 19:31:39 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:31:39 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:31:39 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ae5b07-1d18-4d88-b053-ed5f445e3e0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af039a66-2b66-4a83-bcee-7a8ef1c1559c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:31:39 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:31:39 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:31:39 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:31:39 user nova-compute[75026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 (non-flash)
Nov 10 19:31:39 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:31:39 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0296b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6'): ({'sdd'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Removing single pathed devices sdd {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:31:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858f054-9774-41bf-8475-0d54497b50d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf15f4d-0baa-4a65-93b1-4d46c44161c1]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flushing IO for device /dev/sdd {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6592a20-2213-4f11-8b1f-948682a4c39c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d65614-97aa-4807-a273-61a088eca1e1]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO55c57f17-a483861a37a2e1e8', '/dev/disk/by-id/scsi-26134383338363161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_55c57f17') {{(pid=86097) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc6ba0-cb63-46b4-a151-d647da359143]: (4, None) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4a966b-fb2c-4791-b2be-83a793923f12]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66c9b8-b1da-4899-a4a1-390634366f10]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6, portal: 172.16.0.220,3260]
Nov 10 19:31:40 user nova-compute[75026]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6, portal: 172.16.0.220,3260] successful.
Nov 10 19:31:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed250541-ac31-42b4-ab02-53446a5135d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[11801ef3-b782-4685-be8a-d5aa5c919824]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== disconnect_volume: return (354ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:31:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Deleting instance files /opt/stack/data/nova/instances/dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b_del
Nov 10 19:31:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Deletion of /opt/stack/data/nova/instances/dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b_del complete
Nov 10 19:31:40 user nova-compute[75026]: INFO nova.compute.manager [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received event network-vif-unplugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] Acquiring lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] No waiting events found dispatching network-vif-unplugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received event network-vif-unplugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received event network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] Acquiring lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] No waiting events found dispatching network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:31:40 user nova-compute[75026]: WARNING nova.compute.manager [req-71a51b36-f187-42a9-b5fe-b7e7c6c683b6 req-066f17b3-b956-4038-84fe-d4bb1b3b6e84 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received unexpected event network-vif-plugged-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 for instance with vm_state active and task_state deleting.
Nov 10 19:31:41 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:31:41 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Took 0.76 seconds to deallocate network for instance.
Nov 10 19:31:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:42 user nova-compute[75026]: INFO nova.compute.manager [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Took 1.10 seconds to detach 1 volumes for instance.
Nov 10 19:31:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Deleting volume: ed250541-ac31-42b4-ab02-53446a5135d6 {{(pid=75026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 19:31:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-d01585ca-23e1-45d6-94fe-6a8522d788e7 req-f7c1d5f6-c68b-4a95-8867-cb9c16167be7 service nova] [instance: dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b] Received event network-vif-deleted-d59b6ce5-9f34-4796-b1b0-0d65ac4e6245 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:31:42 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:31:42 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:31:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:42 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Deleted allocations for instance dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b
Nov 10 19:31:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-160bc462-d512-4069-8142-7a14fb2e57ec tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "dafa3aa9-39d1-4b96-97e7-b7b6f3be8e9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.715s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:31:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:31:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:31:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:31:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:31:59 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:31:59 user nova-compute[75026]: INFO nova.compute.claims [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Claim successful on node user
Nov 10 19:31:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:32:00 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.policy [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3a0de9e0cb4826967417d8f29fe839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4399f5415c44727be21445bbee1bc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:32:00 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Creating image(s)
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "/opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "/opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "/opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.199s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Successfully created port: 3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk 1073741824" returned: 0 in 0.051s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Cannot resize image /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Ensure instance console log exists: /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Successfully updated port: 3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "refresh_cache-fae91f15-1f61-467f-ae81-4abf1a6c0a9a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquired lock "refresh_cache-fae91f15-1f61-467f-ae81-4abf1a6c0a9a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-a853a401-d3bc-41a3-a8cc-6b7bf93b58d8 req-58c6e14c-85f0-4d25-9411-402a1c1c6aa0 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received event network-changed-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-a853a401-d3bc-41a3-a8cc-6b7bf93b58d8 req-58c6e14c-85f0-4d25-9411-402a1c1c6aa0 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Refreshing instance network info cache due to event network-changed-3d78a32e-df9e-41c1-84ec-9cb24996d9a7. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a853a401-d3bc-41a3-a8cc-6b7bf93b58d8 req-58c6e14c-85f0-4d25-9411-402a1c1c6aa0 service nova] Acquiring lock "refresh_cache-fae91f15-1f61-467f-ae81-4abf1a6c0a9a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:32:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Updating instance_info_cache with network_info: [{"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Releasing lock "refresh_cache-fae91f15-1f61-467f-ae81-4abf1a6c0a9a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Instance network_info: |[{"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a853a401-d3bc-41a3-a8cc-6b7bf93b58d8 req-58c6e14c-85f0-4d25-9411-402a1c1c6aa0 service nova] Acquired lock "refresh_cache-fae91f15-1f61-467f-ae81-4abf1a6c0a9a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.neutron [req-a853a401-d3bc-41a3-a8cc-6b7bf93b58d8 req-58c6e14c-85f0-4d25-9411-402a1c1c6aa0 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Refreshing network info cache for port 3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Start _get_guest_xml network_info=[{"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:32:02 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:32:02 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2100545023',display_name='tempest-VolumesActionsTest-instance-2100545023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2100545023',id=30,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4399f5415c44727be21445bbee1bc1b',ramdisk_id='',reservation_id='r-22ggladl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1070572732',owner_user_name='tempest-VolumesActionsTest-1070572732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:32:00Z,user_data=None,user_id='fe3a0de9e0cb4826967417d8f29fe839',uuid=fae91f15-1f61-467f-ae81-4abf1a6c0a9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converting VIF {"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d78a32e-df9e-41c1-84ec-9cb24996d9a7,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d78a32e-df') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lazy-loading 'pci_devices' on Instance uuid fae91f15-1f61-467f-ae81-4abf1a6c0a9a {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:32:02 user nova-compute[75026]:   <uuid>fae91f15-1f61-467f-ae81-4abf1a6c0a9a</uuid>
Nov 10 19:32:02 user nova-compute[75026]:   <name>instance-0000001e</name>
Nov 10 19:32:02 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:32:02 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:32:02 user nova-compute[75026]:   <metadata>
Nov 10 19:32:02 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:32:02 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:32:02 user nova-compute[75026]:       <nova:name>tempest-VolumesActionsTest-instance-2100545023</nova:name>
Nov 10 19:32:02 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:32:02</nova:creationTime>
Nov 10 19:32:02 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:32:02 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:32:02 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:32:02 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:32:02 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:32:02 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:32:02 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:32:02 user nova-compute[75026]:       <nova:owner>
Nov 10 19:32:02 user nova-compute[75026]:         <nova:user uuid="fe3a0de9e0cb4826967417d8f29fe839">tempest-VolumesActionsTest-1070572732-project-member</nova:user>
Nov 10 19:32:02 user nova-compute[75026]:         <nova:project uuid="a4399f5415c44727be21445bbee1bc1b">tempest-VolumesActionsTest-1070572732</nova:project>
Nov 10 19:32:02 user nova-compute[75026]:       </nova:owner>
Nov 10 19:32:02 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:32:02 user nova-compute[75026]:       <nova:ports>
Nov 10 19:32:02 user nova-compute[75026]:         <nova:port uuid="3d78a32e-df9e-41c1-84ec-9cb24996d9a7">
Nov 10 19:32:02 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:32:02 user nova-compute[75026]:         </nova:port>
Nov 10 19:32:02 user nova-compute[75026]:       </nova:ports>
Nov 10 19:32:02 user nova-compute[75026]:     </nova:instance>
Nov 10 19:32:02 user nova-compute[75026]:   </metadata>
Nov 10 19:32:02 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:32:02 user nova-compute[75026]:     <system>
Nov 10 19:32:02 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:32:02 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:32:02 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:32:02 user nova-compute[75026]:       <entry name="serial">fae91f15-1f61-467f-ae81-4abf1a6c0a9a</entry>
Nov 10 19:32:02 user nova-compute[75026]:       <entry name="uuid">fae91f15-1f61-467f-ae81-4abf1a6c0a9a</entry>
Nov 10 19:32:02 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:32:02 user nova-compute[75026]:     </system>
Nov 10 19:32:02 user nova-compute[75026]:   </sysinfo>
Nov 10 19:32:02 user nova-compute[75026]:   <os>
Nov 10 19:32:02 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:32:02 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:32:02 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:32:02 user nova-compute[75026]:   </os>
Nov 10 19:32:02 user nova-compute[75026]:   <features>
Nov 10 19:32:02 user nova-compute[75026]:     <acpi/>
Nov 10 19:32:02 user nova-compute[75026]:     <apic/>
Nov 10 19:32:02 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:32:02 user nova-compute[75026]:   </features>
Nov 10 19:32:02 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:32:02 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:32:02 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:32:02 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:32:02 user nova-compute[75026]:   </clock>
Nov 10 19:32:02 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:32:02 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:32:02 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:32:02 user nova-compute[75026]:   </cpu>
Nov 10 19:32:02 user nova-compute[75026]:   <devices>
Nov 10 19:32:02 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:32:02 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:32:02 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk"/>
Nov 10 19:32:02 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:32:02 user nova-compute[75026]:     </disk>
Nov 10 19:32:02 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:32:02 user nova-compute[75026]:       <mac address="fa:16:3e:00:f8:c5"/>
Nov 10 19:32:02 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:32:02 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:32:02 user nova-compute[75026]:       <target dev="tap3d78a32e-df"/>
Nov 10 19:32:02 user nova-compute[75026]:     </interface>
Nov 10 19:32:02 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:32:02 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/console.log" append="off"/>
Nov 10 19:32:02 user nova-compute[75026]:     </serial>
Nov 10 19:32:02 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:32:02 user nova-compute[75026]:     <video>
Nov 10 19:32:02 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:32:02 user nova-compute[75026]:     </video>
Nov 10 19:32:02 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:32:02 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:32:02 user nova-compute[75026]:     </rng>
Nov 10 19:32:02 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:32:02 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:32:02 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:32:02 user nova-compute[75026]:     </memballoon>
Nov 10 19:32:02 user nova-compute[75026]:   </devices>
Nov 10 19:32:02 user nova-compute[75026]: </domain>
Nov 10 19:32:02 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2100545023',display_name='tempest-VolumesActionsTest-instance-2100545023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2100545023',id=30,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4399f5415c44727be21445bbee1bc1b',ramdisk_id='',reservation_id='r-22ggladl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1070572732',owner_user_name='tempest-VolumesActionsTest-1070572732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:32:00Z,user_data=None,user_id='fe3a0de9e0cb4826967417d8f29fe839',uuid=fae91f15-1f61-467f-ae81-4abf1a6c0a9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converting VIF {"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d78a32e-df9e-41c1-84ec-9cb24996d9a7,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d78a32e-df') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG os_vif [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d78a32e-df9e-41c1-84ec-9cb24996d9a7,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d78a32e-df') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80902b78-294f-5af3-92ef-97000e6615a3', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d78a32e-df, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d78a32e-df, col_values=(('qos', UUID('5055c4f6-92bd-425c-bc56-a1980b4cdc7a')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d78a32e-df, col_values=(('external_ids', {'iface-id': '3d78a32e-df9e-41c1-84ec-9cb24996d9a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:f8:c5', 'vm-uuid': 'fae91f15-1f61-467f-ae81-4abf1a6c0a9a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:02 user nova-compute[75026]: INFO os_vif [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d78a32e-df9e-41c1-84ec-9cb24996d9a7,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d78a32e-df')
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-f87feab9-a548-4a45-9c10-f5d3550834b5 req-3f92c80e-1e70-44b4-86ed-bf7b603df270 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received event network-changed-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-f87feab9-a548-4a45-9c10-f5d3550834b5 req-3f92c80e-1e70-44b4-86ed-bf7b603df270 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Refreshing instance network info cache due to event network-changed-1186dc92-705f-4f17-a32c-7129cfdc0a8f. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f87feab9-a548-4a45-9c10-f5d3550834b5 req-3f92c80e-1e70-44b4-86ed-bf7b603df270 service nova] Acquiring lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f87feab9-a548-4a45-9c10-f5d3550834b5 req-3f92c80e-1e70-44b4-86ed-bf7b603df270 service nova] Acquired lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.neutron [req-f87feab9-a548-4a45-9c10-f5d3550834b5 req-3f92c80e-1e70-44b4-86ed-bf7b603df270 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Refreshing network info cache for port 1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] No VIF found with MAC fa:16:3e:00:f8:c5, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.neutron [req-a853a401-d3bc-41a3-a8cc-6b7bf93b58d8 req-58c6e14c-85f0-4d25-9411-402a1c1c6aa0 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Updated VIF entry in instance network info cache for port 3d78a32e-df9e-41c1-84ec-9cb24996d9a7. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.neutron [req-a853a401-d3bc-41a3-a8cc-6b7bf93b58d8 req-58c6e14c-85f0-4d25-9411-402a1c1c6aa0 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Updating instance_info_cache with network_info: [{"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a853a401-d3bc-41a3-a8cc-6b7bf93b58d8 req-58c6e14c-85f0-4d25-9411-402a1c1c6aa0 service nova] Releasing lock "refresh_cache-fae91f15-1f61-467f-ae81-4abf1a6c0a9a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.neutron [req-f87feab9-a548-4a45-9c10-f5d3550834b5 req-3f92c80e-1e70-44b4-86ed-bf7b603df270 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Updated VIF entry in instance network info cache for port 1186dc92-705f-4f17-a32c-7129cfdc0a8f. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG nova.network.neutron [req-f87feab9-a548-4a45-9c10-f5d3550834b5 req-3f92c80e-1e70-44b4-86ed-bf7b603df270 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Updating instance_info_cache with network_info: [{"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:32:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f87feab9-a548-4a45-9c10-f5d3550834b5 req-3f92c80e-1e70-44b4-86ed-bf7b603df270 service nova] Releasing lock "refresh_cache-2f221451-f4c3-441d-8585-b0c41e18bd7f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:32:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:03 user nova-compute[75026]: INFO nova.compute.manager [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Rescuing
Nov 10 19:32:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:32:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquired lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:32:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:32:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-16632339-b649-4ee6-ae5e-02853dd976dc req-2fa0464b-05bf-4abb-ae26-d22cc3208520 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received event network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16632339-b649-4ee6-ae5e-02853dd976dc req-2fa0464b-05bf-4abb-ae26-d22cc3208520 service nova] Acquiring lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16632339-b649-4ee6-ae5e-02853dd976dc req-2fa0464b-05bf-4abb-ae26-d22cc3208520 service nova] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16632339-b649-4ee6-ae5e-02853dd976dc req-2fa0464b-05bf-4abb-ae26-d22cc3208520 service nova] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-16632339-b649-4ee6-ae5e-02853dd976dc req-2fa0464b-05bf-4abb-ae26-d22cc3208520 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] No waiting events found dispatching network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:32:04 user nova-compute[75026]: WARNING nova.compute.manager [req-16632339-b649-4ee6-ae5e-02853dd976dc req-2fa0464b-05bf-4abb-ae26-d22cc3208520 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received unexpected event network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 for instance with vm_state building and task_state spawning.
Nov 10 19:32:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG nova.network.neutron [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Releasing lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-89210481-47c9-4b0c-9a89-c76c7376ce99 req-9ac09786-bba1-48d6-9352-999fb7224c75 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-89210481-47c9-4b0c-9a89-c76c7376ce99 req-9ac09786-bba1-48d6-9352-999fb7224c75 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-89210481-47c9-4b0c-9a89-c76c7376ce99 req-9ac09786-bba1-48d6-9352-999fb7224c75 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-89210481-47c9-4b0c-9a89-c76c7376ce99 req-9ac09786-bba1-48d6-9352-999fb7224c75 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-89210481-47c9-4b0c-9a89-c76c7376ce99 req-9ac09786-bba1-48d6-9352-999fb7224c75 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:32:05 user nova-compute[75026]: WARNING nova.compute.manager [req-89210481-47c9-4b0c-9a89-c76c7376ce99 req-9ac09786-bba1-48d6-9352-999fb7224c75 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state active and task_state rescuing.
Nov 10 19:32:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:05 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance destroyed successfully.
Nov 10 19:32:05 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Attempting a stable device rescue
Nov 10 19:32:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance directory exists: not creating {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 19:32:05 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Creating image(s)
Nov 10 19:32:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "/opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "/opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-68b534bd-ef5a-43c4-90b8-045363d22036 req-b0afc1a9-500f-4c85-90c8-61e7278b1b8c service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received event network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-68b534bd-ef5a-43c4-90b8-045363d22036 req-b0afc1a9-500f-4c85-90c8-61e7278b1b8c service nova] Acquiring lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-68b534bd-ef5a-43c4-90b8-045363d22036 req-b0afc1a9-500f-4c85-90c8-61e7278b1b8c service nova] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-68b534bd-ef5a-43c4-90b8-045363d22036 req-b0afc1a9-500f-4c85-90c8-61e7278b1b8c service nova] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-68b534bd-ef5a-43c4-90b8-045363d22036 req-b0afc1a9-500f-4c85-90c8-61e7278b1b8c service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] No waiting events found dispatching network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:32:06 user nova-compute[75026]: WARNING nova.compute.manager [req-68b534bd-ef5a-43c4-90b8-045363d22036 req-b0afc1a9-500f-4c85-90c8-61e7278b1b8c service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received unexpected event network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 for instance with vm_state building and task_state spawning.
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:32:06 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Instance spawned successfully.
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.virt.images [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] 4ef5777e-12bd-4c78-afa2-57cbdfad917c was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:32:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9.part /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:06 user nova-compute[75026]: INFO nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Took 6.41 seconds to spawn the instance on the hypervisor.
Nov 10 19:32:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:32:07 user nova-compute[75026]: INFO nova.compute.manager [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Took 7.25 seconds to build instance.
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b6311897-359b-41d9-9110-31698fb40239 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.404s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-65a87b03-84aa-4310-a22c-4dee8fd60506 req-f37f447f-d938-48a8-8046-043726a2f2c1 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-65a87b03-84aa-4310-a22c-4dee8fd60506 req-f37f447f-d938-48a8-8046-043726a2f2c1 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-65a87b03-84aa-4310-a22c-4dee8fd60506 req-f37f447f-d938-48a8-8046-043726a2f2c1 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-65a87b03-84aa-4310-a22c-4dee8fd60506 req-f37f447f-d938-48a8-8046-043726a2f2c1 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-65a87b03-84aa-4310-a22c-4dee8fd60506 req-f37f447f-d938-48a8-8046-043726a2f2c1 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:32:07 user nova-compute[75026]: WARNING nova.compute.manager [req-65a87b03-84aa-4310-a22c-4dee8fd60506 req-f37f447f-d938-48a8-8046-043726a2f2c1 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state active and task_state rescuing.
Nov 10 19:32:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9.part /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9.converted" returned: 0 in 0.419s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.852s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9,backing_fmt=raw /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9,backing_fmt=raw /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue" returned: 0 in 0.049s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'migration_context' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.objects.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<3b2146ef-84d2-4180-bea1-e0df77c56804> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Start _get_guest_xml network_info=[{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "vif_mac": "fa:16:3e:fe:af:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4ef5777e-12bd-4c78-afa2-57cbdfad917c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '64363ef4-a864-433c-9e62-71ff664cd414', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnezwMif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3b2146ef-84d2-4180-bea1-e0df77c56804', 'attached_at': '', 'detached_at': '', 'volume_id': '36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'serial': '36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'resources' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.objects.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<3b2146ef-84d2-4180-bea1-e0df77c56804> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'numa_topology' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.objects.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<3b2146ef-84d2-4180-bea1-e0df77c56804> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:32:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:32:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.objects.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<3b2146ef-84d2-4180-bea1-e0df77c56804> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnezwMif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:32:07 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:32:07 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:32:07 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[694074c8-2a8c-4c13-b9e3-f879229948ba]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vnezwMif\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 19:32:07 user nova-compute[75026]: node.name = iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:32:07 user nova-compute[75026]: node.tpgt = -1
Nov 10 19:32:07 user nova-compute[75026]: node.startup = automatic
Nov 10 19:32:07 user nova-compute[75026]: node.leading_login = No
Nov 10 19:32:07 user nova-compute[75026]: iface.iscsi_ifacename = default
Nov 10 19:32:07 user nova-compute[75026]: iface.net_ifacename = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.ipaddress = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.prefix_len = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.hwaddress = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.transport_name = tcp
Nov 10 19:32:07 user nova-compute[75026]: iface.initiatorname = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.state = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.vlan_id = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.vlan_priority = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.vlan_state = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.iface_num = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.mtu = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.port = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.bootproto = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.subnet_mask = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.gateway = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.dhcp_alt_client_id = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.dhcp_dns = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.dhcp_learn_iqn = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.dhcp_vendor_id_state = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.dhcp_vendor_id = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.dhcp_slp_da = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.fragmentation = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.gratuitous_arp = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.incoming_forwarding = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.tos_state = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.tos = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.ttl = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.delayed_ack = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.tcp_nagle = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.tcp_wsf_state = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.tcp_wsf = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.tcp_timer_scale = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.tcp_timestamp = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.redirect = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.def_task_mgmt_timeout = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.header_digest = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.data_digest = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.immediate_data = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.initial_r2t = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.data_seq_inorder = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.data_pdu_inorder = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.erl = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.max_receive_data_len = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.first_burst_len = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.max_outstanding_r2t = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.max_burst_len = 0
Nov 10 19:32:07 user nova-compute[75026]: iface.chap_auth = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.bidi_chap = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.strict_login_compliance = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.discovery_auth = <empty>
Nov 10 19:32:07 user nova-compute[75026]: iface.discovery_logout = <empty>
Nov 10 19:32:07 user nova-compute[75026]: node.discovery_address = <empty>
Nov 10 19:32:07 user nova-compute[75026]: node.discovery_port = 0
Nov 10 19:32:07 user nova-compute[75026]: node.discovery_type = static
Nov 10 19:32:07 user nova-compute[75026]: node.session.initial_cmdsn = 0
Nov 10 19:32:07 user nova-compute[75026]: node.session.initial_login_retry_max = 8
Nov 10 19:32:07 user nova-compute[75026]: node.session.xmit_thread_priority = -20
Nov 10 19:32:07 user nova-compute[75026]: node.session.cmds_max = 128
Nov 10 19:32:07 user nova-compute[75026]: node.session.queue_depth = 32
Nov 10 19:32:07 user nova-compute[75026]: node.session.nr_sessions = 1
Nov 10 19:32:07 user nova-compute[75026]: node.session.auth.authmethod = CHAP
Nov 10 19:32:07 user nova-compute[75026]: node.session.auth.username = vnezwMif
Nov 10 19:32:07 user nova-compute[75026]: node.session.auth.password = ***
Nov 10 19:32:07 user nova-compute[75026]: node.session.auth.username_in = <empty>
Nov 10 19:32:07 user nova-compute[75026]: node.session.auth.password_in = <empty>
Nov 10 19:32:07 user nova-compute[75026]: node.session.auth.chap_algs = MD5
Nov 10 19:32:07 user nova-compute[75026]: node.session.timeo.replacement_timeout = 120
Nov 10 19:32:07 user nova-compute[75026]: node.session.err_timeo.abort_timeout = 15
Nov 10 19:32:07 user nova-compute[75026]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 19:32:07 user nova-compute[75026]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 19:32:07 user nova-compute[75026]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.FastAbort = Yes
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.InitialR2T = No
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.ImmediateData = Yes
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.MaxConnections = 1
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 19:32:07 user nova-compute[75026]: node.session.iscsi.ERL = 0
Nov 10 19:32:07 user nova-compute[75026]: node.session.scan = manual
Nov 10 19:32:07 user nova-compute[75026]: node.session.reopen_max = 0
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].address = 172.16.0.220
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].port = 3260
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].startup = manual
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].tcp.window_size = 524288
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].tcp.type_of_service = 0
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].timeo.logout_timeout = 15
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].timeo.login_timeout = 15
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].timeo.auth_timeout = 45
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].iscsi.DataDigest = None
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].iscsi.IFMarker = No
Nov 10 19:32:07 user nova-compute[75026]: node.conn[0].iscsi.OFMarker = No
Nov 10 19:32:07 user nova-compute[75026]: # END RECORD
Nov 10 19:32:07 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[947e2bfb-4d42-4472-9f4b-5258500db8c8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[365aaef1-45d0-4232-806a-31315dd72e9a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vnezwMif {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vnezwMif" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c981a1dc-b498-49e1-a47f-67b2c4d2bfea]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vnezwMif'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de1e1bb-7046-4e6f-94ed-6f26b8272833]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[00766002-95e2-4729-b45d-55f741f2201e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:32:08 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:32:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:32:08 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:32:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] HCTL ('36', '0', '0', 0) found on session 26 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c49657-c6ac-4505-aec3-9e59fcbb0939]: (4, ('0 0 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching for a device in session 26 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnezwMif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.197s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] <== connect_volume: return (198ms) {'type': 'block', 'scsi_wwn': '23565303431373830', 'path': '/dev/sde'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565303431373830', 'path': '/dev/sde'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-356811107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-356811107',id=23,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-ll4c8m2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:30:44Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=3b2146ef-84d2-4180-bea1-e0df77c56804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "vif_mac": "fa:16:3e:fe:af:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "vif_mac": "fa:16:3e:fe:af:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:af:dc,bridge_name='br-int',has_traffic_filtering=True,id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927b3f92-a9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.objects.base [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<3b2146ef-84d2-4180-bea1-e0df77c56804> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:32:08 user nova-compute[75026]:   <uuid>3b2146ef-84d2-4180-bea1-e0df77c56804</uuid>
Nov 10 19:32:08 user nova-compute[75026]:   <name>instance-00000017</name>
Nov 10 19:32:08 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:32:08 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:32:08 user nova-compute[75026]:   <metadata>
Nov 10 19:32:08 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:32:08 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:32:08 user nova-compute[75026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-356811107</nova:name>
Nov 10 19:32:08 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:32:07</nova:creationTime>
Nov 10 19:32:08 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:32:08 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:32:08 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:32:08 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:32:08 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:32:08 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:32:08 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:32:08 user nova-compute[75026]:       <nova:owner>
Nov 10 19:32:08 user nova-compute[75026]:         <nova:user uuid="fcbd2be26ec84b5d9f6f6638963e870e">tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member</nova:user>
Nov 10 19:32:08 user nova-compute[75026]:         <nova:project uuid="43e468483e8f4f70bd228ff8194d76b7">tempest-ServerBootFromVolumeStableRescueTest-1118157225</nova:project>
Nov 10 19:32:08 user nova-compute[75026]:       </nova:owner>
Nov 10 19:32:08 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:32:08 user nova-compute[75026]:       <nova:ports>
Nov 10 19:32:08 user nova-compute[75026]:         <nova:port uuid="927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e">
Nov 10 19:32:08 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 19:32:08 user nova-compute[75026]:         </nova:port>
Nov 10 19:32:08 user nova-compute[75026]:       </nova:ports>
Nov 10 19:32:08 user nova-compute[75026]:     </nova:instance>
Nov 10 19:32:08 user nova-compute[75026]:   </metadata>
Nov 10 19:32:08 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:32:08 user nova-compute[75026]:     <system>
Nov 10 19:32:08 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:32:08 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:32:08 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:32:08 user nova-compute[75026]:       <entry name="serial">3b2146ef-84d2-4180-bea1-e0df77c56804</entry>
Nov 10 19:32:08 user nova-compute[75026]:       <entry name="uuid">3b2146ef-84d2-4180-bea1-e0df77c56804</entry>
Nov 10 19:32:08 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:32:08 user nova-compute[75026]:     </system>
Nov 10 19:32:08 user nova-compute[75026]:   </sysinfo>
Nov 10 19:32:08 user nova-compute[75026]:   <os>
Nov 10 19:32:08 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:32:08 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:32:08 user nova-compute[75026]:   </os>
Nov 10 19:32:08 user nova-compute[75026]:   <features>
Nov 10 19:32:08 user nova-compute[75026]:     <acpi/>
Nov 10 19:32:08 user nova-compute[75026]:     <apic/>
Nov 10 19:32:08 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:32:08 user nova-compute[75026]:   </features>
Nov 10 19:32:08 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:32:08 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:32:08 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:32:08 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:32:08 user nova-compute[75026]:   </clock>
Nov 10 19:32:08 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:32:08 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:32:08 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:32:08 user nova-compute[75026]:   </cpu>
Nov 10 19:32:08 user nova-compute[75026]:   <devices>
Nov 10 19:32:08 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:32:08 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:32:08 user nova-compute[75026]:       <source dev="/dev/sde"/>
Nov 10 19:32:08 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:32:08 user nova-compute[75026]:       <serial>36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4</serial>
Nov 10 19:32:08 user nova-compute[75026]:     </disk>
Nov 10 19:32:08 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:32:08 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:32:08 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue"/>
Nov 10 19:32:08 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:32:08 user nova-compute[75026]:       <boot order="1"/>
Nov 10 19:32:08 user nova-compute[75026]:     </disk>
Nov 10 19:32:08 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:32:08 user nova-compute[75026]:       <mac address="fa:16:3e:fe:af:dc"/>
Nov 10 19:32:08 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:32:08 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:32:08 user nova-compute[75026]:       <target dev="tap927b3f92-a9"/>
Nov 10 19:32:08 user nova-compute[75026]:     </interface>
Nov 10 19:32:08 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:32:08 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/console.log" append="off"/>
Nov 10 19:32:08 user nova-compute[75026]:     </serial>
Nov 10 19:32:08 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:32:08 user nova-compute[75026]:     <video>
Nov 10 19:32:08 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:32:08 user nova-compute[75026]:     </video>
Nov 10 19:32:08 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:32:08 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:32:08 user nova-compute[75026]:     </rng>
Nov 10 19:32:08 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:32:08 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:32:08 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:32:08 user nova-compute[75026]:     </memballoon>
Nov 10 19:32:08 user nova-compute[75026]:   </devices>
Nov 10 19:32:08 user nova-compute[75026]: </domain>
Nov 10 19:32:08 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:32:08 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance destroyed successfully.
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No VIF found with MAC fa:16:3e:fe:af:dc, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:32:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'flavor' on Instance uuid 2f221451-f4c3-441d-8585-b0c41e18bd7f {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:09 user nova-compute[75026]: INFO nova.compute.manager [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Attaching volume 353eab87-cb8a-49f7-8cc6-c303d5ae9964 to /dev/vdb
Nov 10 19:32:09 user nova-compute[75026]: DEBUG os_brick.utils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acdfba2-8a70-49c4-b73f-7ae5059e03df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb05745-9bd6-409c-b6e8-ba1896fa6a6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4644f33f-7d3b-4e32-ad34-d017ca5c1dd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bf2be6-8e65-4509-a580-f26562a9562c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG nova.compute.manager [req-08f1fa83-1444-45d0-bef2-d16dab81ec5a req-640c73d7-5cf4-4b11-9ba7-bf7fbe1d43e7 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-08f1fa83-1444-45d0-bef2-d16dab81ec5a req-640c73d7-5cf4-4b11-9ba7-bf7fbe1d43e7 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-08f1fa83-1444-45d0-bef2-d16dab81ec5a req-640c73d7-5cf4-4b11-9ba7-bf7fbe1d43e7 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-08f1fa83-1444-45d0-bef2-d16dab81ec5a req-640c73d7-5cf4-4b11-9ba7-bf7fbe1d43e7 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG nova.compute.manager [req-08f1fa83-1444-45d0-bef2-d16dab81ec5a req-640c73d7-5cf4-4b11-9ba7-bf7fbe1d43e7 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:32:09 user nova-compute[75026]: WARNING nova.compute.manager [req-08f1fa83-1444-45d0-bef2-d16dab81ec5a req-640c73d7-5cf4-4b11-9ba7-bf7fbe1d43e7 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state active and task_state rescuing.
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:32:09 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:32:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d27c5ed-5410-48da-b2bf-fe40866daa6d]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG os_brick.utils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:32:09 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Updating existing volume attachment record: 646d32e2-469c-4dd6-9a65-8363a43398ee {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:32:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-167ab19b-05aa-4b6e-9f38-16958a746db8 req-f3daf9f1-ea91-48ab-a8a2-dc4ff053ae8a service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-167ab19b-05aa-4b6e-9f38-16958a746db8 req-f3daf9f1-ea91-48ab-a8a2-dc4ff053ae8a service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-167ab19b-05aa-4b6e-9f38-16958a746db8 req-f3daf9f1-ea91-48ab-a8a2-dc4ff053ae8a service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-167ab19b-05aa-4b6e-9f38-16958a746db8 req-f3daf9f1-ea91-48ab-a8a2-dc4ff053ae8a service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-167ab19b-05aa-4b6e-9f38-16958a746db8 req-f3daf9f1-ea91-48ab-a8a2-dc4ff053ae8a service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:32:12 user nova-compute[75026]: WARNING nova.compute.manager [req-167ab19b-05aa-4b6e-9f38-16958a746db8 req-f3daf9f1-ea91-48ab-a8a2-dc4ff053ae8a service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state active and task_state rescuing.
Nov 10 19:32:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2e083327-3da5-47e4-8289-a41e5ab16bee tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:32:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:15 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:32:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:32:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:32:15 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:32:16 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:32:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:32:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:32:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:20 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:32:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG nova.objects.instance [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lazy-loading 'flavor' on Instance uuid b5a70279-1a95-4c83-8243-b3bcb06fdbee {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:23 user nova-compute[75026]: INFO nova.compute.manager [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Attaching volume 804f4c4d-20fe-431d-94f7-28629139c43c to /dev/vdb
Nov 10 19:32:23 user nova-compute[75026]: DEBUG os_brick.utils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[acda8b53-9bf2-4477-86f7-db8f700e44a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9cabf0-751a-4f29-b13b-5779d48c10d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1bc70b-5aaa-49a0-b60d-739cb6ba83ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[780d313e-c53e-431f-a572-a288b07503c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:32:23 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf95922-d306-437a-8a39-d0c40b58da65]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG os_brick.utils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updating existing volume attachment record: a943d096-9e85-48e2-8d46-d1cc84febdbd {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:25 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:32:25 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7661MB free_disk=25.34463882446289GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 00fbb0b3-a888-4348-ad97-41aed258ff13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5a70279-1a95-4c83-8243-b3bcb06fdbee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2f221451-f4c3-441d-8585-b0c41e18bd7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fae91f15-1f61-467f-ae81-4abf1a6c0a9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.714s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:32:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:32:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:32:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:32:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Acquiring lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:35 user nova-compute[75026]: INFO nova.compute.manager [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Unshelving
Nov 10 19:32:36 user nova-compute[75026]: INFO nova.virt.block_device [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Booting with volume 58dcd553-406e-46b2-aea9-c3d72298d832 at /dev/vda
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.utils [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ec8e55-47cd-43c4-a519-ca731c8ff4fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b055375-b5bc-453f-8869-5a6b0d28bb73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f137a5-648a-4e6a-9aac-28dcfd2fc653]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bc4c3a-4c34-41db-89ef-0c725ab3fa58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:32:36 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d76e4b-beee-4d68-ad1d-f41bb88c96ce]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.utils [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Updating existing volume attachment record: 1f0de71e-ea6e-4f8f-a812-b1caa1acd30d {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGcbTMOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:32:36 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:32:36 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:32:36 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc3ad68-fd94-4aff-8f50-4bd3b1f148f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:32:36 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04300f98-8a71-401b-ad8c-6d047c7ce59a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964] added
Nov 10 19:32:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[27269bd3-8fca-4465-bf73-e7e6775f5a10]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11b85cd-7530-4258-ab48-39e5fdedb734]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGcbTMOt {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGcbTMOt" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddafe1d3-d87b-4e35-bc63-4d6349eb835c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SGcbTMOt'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[13517321-8c90-455f-8b15-b46e3ba729f3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8136a9df-90bd-46f1-8454-bd42e9f334fb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:32:37 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:32:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:32:37 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:32:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2829156-103c-46e6-ab64-785f6014e137]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964, portal: 172.16.0.220,3260]
Nov 10 19:32:37 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964, portal: 172.16.0.220,3260] successful.
Nov 10 19:32:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[166ea949-a191-4396-b427-6a144025d718]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbeb4c6-d84a-4a1d-9640-bac05cc5bb8a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:32:37 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:32:37 user nova-compute[75026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)
Nov 10 19:32:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:32:37 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:32:37 user nova-compute[75026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)
Nov 10 19:32:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80d804-e71a-4aa6-b604-173d02e41652]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:32:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGcbTMOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23962343964616561', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962343964616561', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG nova.objects.instance [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'flavor' on Instance uuid 2f221451-f4c3-441d-8585-b0c41e18bd7f {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:32:38 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:32:38 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:32:38 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:32:38 user nova-compute[75026]:   <serial>353eab87-cb8a-49f7-8cc6-c303d5ae9964</serial>
Nov 10 19:32:38 user nova-compute[75026]: </disk>
Nov 10 19:32:38 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:32:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No VIF found with MAC fa:16:3e:85:30:14, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:32:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26b40a24-b933-40a5-a191-357cbe80bb42 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.356s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:39 user nova-compute[75026]: INFO nova.compute.manager [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Detaching volume 353eab87-cb8a-49f7-8cc6-c303d5ae9964
Nov 10 19:32:39 user nova-compute[75026]: INFO nova.virt.block_device [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Attempting to driver detach volume 353eab87-cb8a-49f7-8cc6-c303d5ae9964 from mountpoint /dev/vdb
Nov 10 19:32:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Attempting to detach device vdb from instance 2f221451-f4c3-441d-8585-b0c41e18bd7f from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:32:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:32:39 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:32:39 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:32:39 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:32:39 user nova-compute[75026]:   <serial>353eab87-cb8a-49f7-8cc6-c303d5ae9964</serial>
Nov 10 19:32:39 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:32:39 user nova-compute[75026]: </disk>
Nov 10 19:32:39 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:32:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully detached device vdb from instance 2f221451-f4c3-441d-8585-b0c41e18bd7f from the persistent domain config.
Nov 10 19:32:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f221451-f4c3-441d-8585-b0c41e18bd7f from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:32:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:32:40 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:32:40 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:32:40 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:32:40 user nova-compute[75026]:   <serial>353eab87-cb8a-49f7-8cc6-c303d5ae9964</serial>
Nov 10 19:32:40 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:32:40 user nova-compute[75026]: </disk>
Nov 10 19:32:40 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:32:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f221451-f4c3-441d-8585-b0c41e18bd7f {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "00fbb0b3-a888-4348-ad97-41aed258ff13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:41 user nova-compute[75026]: INFO nova.compute.manager [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Terminating instance
Nov 10 19:32:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa16354f-fb8c-405b-b6c8-23ea4c00b954 req-28bd8730-5771-4644-b04d-9b8d1ee38f5d service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received event network-vif-unplugged-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa16354f-fb8c-405b-b6c8-23ea4c00b954 req-28bd8730-5771-4644-b04d-9b8d1ee38f5d service nova] Acquiring lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa16354f-fb8c-405b-b6c8-23ea4c00b954 req-28bd8730-5771-4644-b04d-9b8d1ee38f5d service nova] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa16354f-fb8c-405b-b6c8-23ea4c00b954 req-28bd8730-5771-4644-b04d-9b8d1ee38f5d service nova] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa16354f-fb8c-405b-b6c8-23ea4c00b954 req-28bd8730-5771-4644-b04d-9b8d1ee38f5d service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] No waiting events found dispatching network-vif-unplugged-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa16354f-fb8c-405b-b6c8-23ea4c00b954 req-28bd8730-5771-4644-b04d-9b8d1ee38f5d service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received event network-vif-unplugged-e20e129d-37c2-469e-aac2-349d1f175fe8 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:32:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Instance destroyed successfully.
Nov 10 19:32:42 user nova-compute[75026]: DEBUG nova.objects.instance [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'resources' on Instance uuid 00fbb0b3-a888-4348-ad97-41aed258ff13 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1649925711',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1649925711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1649925711',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkpQfCpxQaJFEIKQWdeC37BqcHxoyU5m4fAuH2Imvs+huMEcaWrTWR4PzPb3+npgHc7zvS91p0CQEVGMzIYNU3S355B0r8qO4jTPr/Ont3bzA+tHWf3L0Umj55A6i6rcQ==',key_name='tempest-keypair-751049902',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-wa00uwo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='758478b59f94467898696fa7af7cd630',uuid=00fbb0b3-a888-4348-ad97-41aed258ff13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "e20e129d-37c2-469e-aac2-349d1f175fe8", "address": "fa:16:3e:cd:eb:36", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20e129d-37", "ovs_interfaceid": "e20e129d-37c2-469e-aac2-349d1f175fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=e20e129d-37c2-469e-aac2-349d1f175fe8,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20e129d-37') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_vif [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=e20e129d-37c2-469e-aac2-349d1f175fe8,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20e129d-37') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape20e129d-37, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99bccd8b-886b-4208-87d2-6640e59484bb) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:32:42 user nova-compute[75026]: INFO os_vif [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:eb:36,bridge_name='br-int',has_traffic_filtering=True,id=e20e129d-37c2-469e-aac2-349d1f175fe8,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20e129d-37')
Nov 10 19:32:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlyKWYJq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:32:42 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c516131d-7972-4d0a-b9ee-5be8debec45c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:32:42 user nova-compute[75026]: No targets found.
Nov 10 19:32:42 user nova-compute[75026]: iSNS:
Nov 10 19:32:42 user nova-compute[75026]: No targets found.
Nov 10 19:32:42 user nova-compute[75026]: STATIC:
Nov 10 19:32:42 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:32:42 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:32:42 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:32:42 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b
Nov 10 19:32:42 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:32:42 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:32:42 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964
Nov 10 19:32:42 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:32:42 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:32:42 user nova-compute[75026]: FIRMWARE:
Nov 10 19:32:42 user nova-compute[75026]: No targets found.
Nov 10 19:32:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:32:42 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:32:42 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b1e4c-f671-45ef-a614-567b068eca75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc036ab-2ce4-4d58-9556-91675770c2e8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:32:42 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:32:42 user nova-compute[75026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)
Nov 10 19:32:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b (non-flash)
Nov 10 19:32:42 user nova-compute[75026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:32:42 user nova-compute[75026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)
Nov 10 19:32:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0e303a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da36be79-7472-46f1-b305-e82e225ac1dd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b46f70-632a-4e39-9e7b-d94570046094]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7babdb8-5961-42d4-aeca-07303a46316b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c0e3d6-a85a-4b7f-9efc-80bb3391c3d6]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8ee293b-ef05c5da3e184a34', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8ee293b', '/dev/disk/by-id/scsi-26566303563356461') {{(pid=86097) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1b08f1-8ef3-4b57-92a6-789b64a256d2]: (4, None) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d499e210-67ce-45a3-83d4-1577c3afe1ef]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8004c171-92c7-4fb5-b6eb-88d7607dadbf]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b, portal: 172.16.0.220,3260]
Nov 10 19:32:42 user nova-compute[75026]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b, portal: 172.16.0.220,3260] successful.
Nov 10 19:32:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f64ea220-d986-439c-8954-61477fe1244b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[586fc4a7-c83c-4948-9d05-38ad441e92a7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== disconnect_volume: return (349ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:32:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Deleting instance files /opt/stack/data/nova/instances/00fbb0b3-a888-4348-ad97-41aed258ff13_del
Nov 10 19:32:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Deletion of /opt/stack/data/nova/instances/00fbb0b3-a888-4348-ad97-41aed258ff13_del complete
Nov 10 19:32:42 user nova-compute[75026]: INFO nova.compute.manager [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 19:32:42 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:32:42 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:32:43 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:32:43 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Took 0.74 seconds to deallocate network for instance.
Nov 10 19:32:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-7a54f75b-fb7c-434f-a777-295df7b58b7a req-8e5ffc83-fc10-4480-b269-e4351d41565a service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received event network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7a54f75b-fb7c-434f-a777-295df7b58b7a req-8e5ffc83-fc10-4480-b269-e4351d41565a service nova] Acquiring lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7a54f75b-fb7c-434f-a777-295df7b58b7a req-8e5ffc83-fc10-4480-b269-e4351d41565a service nova] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7a54f75b-fb7c-434f-a777-295df7b58b7a req-8e5ffc83-fc10-4480-b269-e4351d41565a service nova] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-7a54f75b-fb7c-434f-a777-295df7b58b7a req-8e5ffc83-fc10-4480-b269-e4351d41565a service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] No waiting events found dispatching network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:32:43 user nova-compute[75026]: WARNING nova.compute.manager [req-7a54f75b-fb7c-434f-a777-295df7b58b7a req-8e5ffc83-fc10-4480-b269-e4351d41565a service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received unexpected event network-vif-plugged-e20e129d-37c2-469e-aac2-349d1f175fe8 for instance with vm_state active and task_state deleting.
Nov 10 19:32:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-7a54f75b-fb7c-434f-a777-295df7b58b7a req-8e5ffc83-fc10-4480-b269-e4351d41565a service nova] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Received event network-vif-deleted-e20e129d-37c2-469e-aac2-349d1f175fe8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:44 user nova-compute[75026]: INFO nova.compute.manager [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Took 1.01 seconds to detach 1 volumes for instance.
Nov 10 19:32:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 00fbb0b3-a888-4348-ad97-41aed258ff13] Deleting volume: f64ea220-d986-439c-8954-61477fe1244b {{(pid=75026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.volume.cinder [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Update attachment failed for attachment 1f0de71e-ea6e-4f8f-a812-b1caa1acd30d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0d8afaca-8dc7-4ef9-972f-72a480b0f05c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0d8afaca-8dc7-4ef9-972f-72a480b0f05c)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0d8afaca-8dc7-4ef9-972f-72a480b0f05c)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Traceback (most recent call last):
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     driver_block_device.attach_block_devices(
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     _log_and_attach(device)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     self._do_attach(context, instance, volume, volume_api,
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     self._volume_attach(context, volume, connector, instance,
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     connection_info = volume_api.attachment_update(
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     res = method(self, ctx, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     with excutils.save_and_reraise_exception():
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     self.force_reraise()
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     raise self.value
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     return method.func(obj, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     resp = self._update('/attachments/%s' % id, body)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     return self.request(url, method, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872]     raise exceptions.from_response(resp, body)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0d8afaca-8dc7-4ef9-972f-72a480b0f05c)
Nov 10 19:32:44 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] 
Nov 10 19:32:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Lock "b5d275d9-e5fe-425c-9dfb-270a989a6872" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 8.912s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:32:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:44 user nova-compute[75026]: INFO nova.compute.manager [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] [instance: b5d275d9-e5fe-425c-9dfb-270a989a6872] Successfully reverted task state from spawning on failure for instance.
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server [None req-655d52fa-c4da-49ff-b33c-fa46850b6632 tempest-TestShelveInstance-731674373 tempest-TestShelveInstance-731674373-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0d8afaca-8dc7-4ef9-972f-72a480b0f05c)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0d8afaca-8dc7-4ef9-972f-72a480b0f05c)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7083, in unshelve_instance
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7080, in do_unshelve_instance
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7112, in _unshelve_instance
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0d8afaca-8dc7-4ef9-972f-72a480b0f05c)
Nov 10 19:32:44 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:32:45 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Deleted allocations for instance 00fbb0b3-a888-4348-ad97-41aed258ff13
Nov 10 19:32:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-43ad00d4-0d0e-4747-ba23-a4d3ed788658 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "00fbb0b3-a888-4348-ad97-41aed258ff13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.811s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.volume.cinder [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Update attachment failed for attachment a943d096-9e85-48e2-8d46-d1cc84febdbd. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ed32452-ddfc-4a80-b2cb-2eff32ec4ad7) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ed32452-ddfc-4a80-b2cb-2eff32ec4ad7)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Failed to attach 804f4c4d-20fe-431d-94f7-28629139c43c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ed32452-ddfc-4a80-b2cb-2eff32ec4ad7)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Traceback (most recent call last):
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     self._do_attach(context, instance, volume, volume_api,
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     self._volume_attach(context, volume, connector, instance,
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     connection_info = volume_api.attachment_update(
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     res = method(self, ctx, *args, **kwargs)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     with excutils.save_and_reraise_exception():
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     self.force_reraise()
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     raise self.value
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     return method.func(obj, *args, **kwargs)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     resp = self._update('/attachments/%s' % id, body)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     return self.request(url, method, **kwargs)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee]     raise exceptions.from_response(resp, body)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ed32452-ddfc-4a80-b2cb-2eff32ec4ad7)
Nov 10 19:32:50 user nova-compute[75026]: ERROR nova.compute.manager [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] 
Nov 10 19:32:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.678s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server [None req-0cc7d94a-57ec-4e6e-8d07-14c7a2ef0fce tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ed32452-ddfc-4a80-b2cb-2eff32ec4ad7)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ed32452-ddfc-4a80-b2cb-2eff32ec4ad7)
Nov 10 19:32:51 user nova-compute[75026]: ERROR oslo_messaging.rpc.server 
Nov 10 19:32:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-cc9832fb-3525-48f7-8b81-6afd37d1b535 req-6ed62fd1-1ff9-4b33-8e67-06ee380d8786 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received event network-changed-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-cc9832fb-3525-48f7-8b81-6afd37d1b535 req-6ed62fd1-1ff9-4b33-8e67-06ee380d8786 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Refreshing instance network info cache due to event network-changed-f4916190-3b62-43b2-a609-5671b8392ccc. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cc9832fb-3525-48f7-8b81-6afd37d1b535 req-6ed62fd1-1ff9-4b33-8e67-06ee380d8786 service nova] Acquiring lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cc9832fb-3525-48f7-8b81-6afd37d1b535 req-6ed62fd1-1ff9-4b33-8e67-06ee380d8786 service nova] Acquired lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG nova.network.neutron [req-cc9832fb-3525-48f7-8b81-6afd37d1b535 req-6ed62fd1-1ff9-4b33-8e67-06ee380d8786 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Refreshing network info cache for port f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'flavor' on Instance uuid ccbe3f6e-3b3b-4ca7-b784-2adf16555910 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:32:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Ignoring supplied device name: /dev/vdb
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG nova.network.neutron [req-cc9832fb-3525-48f7-8b81-6afd37d1b535 req-6ed62fd1-1ff9-4b33-8e67-06ee380d8786 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Updated VIF entry in instance network info cache for port f4916190-3b62-43b2-a609-5671b8392ccc. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG nova.network.neutron [req-cc9832fb-3525-48f7-8b81-6afd37d1b535 req-6ed62fd1-1ff9-4b33-8e67-06ee380d8786 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Updating instance_info_cache with network_info: [{"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:32:52 user nova-compute[75026]: INFO nova.compute.manager [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Attaching volume ec7f9ad0-7fb2-43d4-b919-9c144cddd567 to /dev/vdb
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cc9832fb-3525-48f7-8b81-6afd37d1b535 req-6ed62fd1-1ff9-4b33-8e67-06ee380d8786 service nova] Releasing lock "refresh_cache-ccbe3f6e-3b3b-4ca7-b784-2adf16555910" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG os_brick.utils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d264bfa-2a83-4c62-8420-fab0e530a796]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eec1dfa-fce3-4d70-b706-4734c3b283f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dbe026-f0b2-47b2-a46b-2ead0e2f0b25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[90786f68-8140-4514-93fb-27fd8ff82a64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:32:53 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:32:53 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc02e17-9ff3-4382-b3f0-0c108b446d71]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG os_brick.utils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Updating existing volume attachment record: b0e62ec0-384f-4b64-92c9-a0829f2009da {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:32:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:32:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:00 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f221451-f4c3-441d-8585-b0c41e18bd7f is timed out.
Nov 10 19:33:00 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully detached device vdb from instance 2f221451-f4c3-441d-8585-b0c41e18bd7f from the live domain config.
Nov 10 19:33:00 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGcbTMOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:33:00 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ab9093-06e7-4bf3-ae37-ed57bdb9b17a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:33:00 user nova-compute[75026]: No targets found.
Nov 10 19:33:00 user nova-compute[75026]: iSNS:
Nov 10 19:33:00 user nova-compute[75026]: No targets found.
Nov 10 19:33:00 user nova-compute[75026]: STATIC:
Nov 10 19:33:00 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:33:00 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:33:00 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:33:00 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964
Nov 10 19:33:00 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:33:00 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:33:00 user nova-compute[75026]: FIRMWARE:
Nov 10 19:33:00 user nova-compute[75026]: No targets found.
Nov 10 19:33:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:33:00 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:33:00 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f03b04-8731-40dc-932b-dea69992e9aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e23c15-9a5b-49db-b9c0-fa3f69193a4e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:00 user nova-compute[75026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)
Nov 10 19:33:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:00 user nova-compute[75026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 (non-flash)
Nov 10 19:33:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda050d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9da2686-7002-48fe-ae83-76c00c5e5a9b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be3e057-655a-4778-ac87-fad19ada1117]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fdedbe-f0f9-4f54-a970-17a6755f50b4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6c284e-9862-4490-bab5-bf93253494ea]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37379ff-033f-44fc-9832-7d6b1a71ce35]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d04e2c-3425-4258-ad5a-228ba8880f2c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964, portal: 172.16.0.220,3260]
Nov 10 19:33:00 user nova-compute[75026]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964, portal: 172.16.0.220,3260] successful.
Nov 10 19:33:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353eab87-cb8a-49f7-8cc6-c303d5ae9964 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20c1c7a-5dfb-4321-a061-89bc32355acd]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] <== disconnect_volume: return (270ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:33:00 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:33:01 user nova-compute[75026]: DEBUG nova.objects.instance [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'flavor' on Instance uuid 2f221451-f4c3-441d-8585-b0c41e18bd7f {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:33:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-67ef1b4d-7bae-45e9-82e9-bef9e6c83d36 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.797s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid b9e39b1a-3119-456e-b16d-192dbcd66ae3 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 9bcd68f9-db0e-4dd0-a831-c985e575ff9e {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid b5a70279-1a95-4c83-8243-b3bcb06fdbee {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 2f221451-f4c3-441d-8585-b0c41e18bd7f {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid ccbe3f6e-3b3b-4ca7-b784-2adf16555910 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 2a333e19-c760-441d-bb5a-392d1f25b7e1 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid fae91f15-1f61-467f-ae81-4abf1a6c0a9a {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:13 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-bfa0ce68-ef10-415a-a58f-3f2679de4053 req-a1fc3f7a-76d1-4ede-9520-7cf95ff38562 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-changed-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-bfa0ce68-ef10-415a-a58f-3f2679de4053 req-a1fc3f7a-76d1-4ede-9520-7cf95ff38562 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Refreshing instance network info cache due to event network-changed-fc38295a-d9ab-42e2-83c7-8623dc67f022. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:33:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfa0ce68-ef10-415a-a58f-3f2679de4053 req-a1fc3f7a-76d1-4ede-9520-7cf95ff38562 service nova] Acquiring lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:33:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfa0ce68-ef10-415a-a58f-3f2679de4053 req-a1fc3f7a-76d1-4ede-9520-7cf95ff38562 service nova] Acquired lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:33:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfa0ce68-ef10-415a-a58f-3f2679de4053 req-a1fc3f7a-76d1-4ede-9520-7cf95ff38562 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Refreshing network info cache for port fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfa0ce68-ef10-415a-a58f-3f2679de4053 req-a1fc3f7a-76d1-4ede-9520-7cf95ff38562 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Updated VIF entry in instance network info cache for port fc38295a-d9ab-42e2-83c7-8623dc67f022. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-bfa0ce68-ef10-415a-a58f-3f2679de4053 req-a1fc3f7a-76d1-4ede-9520-7cf95ff38562 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Updating instance_info_cache with network_info: [{"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bfa0ce68-ef10-415a-a58f-3f2679de4053 req-a1fc3f7a-76d1-4ede-9520-7cf95ff38562 service nova] Releasing lock "refresh_cache-2a333e19-c760-441d-bb5a-392d1f25b7e1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG nova.objects.instance [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'flavor' on Instance uuid 2a333e19-c760-441d-bb5a-392d1f25b7e1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:15 user nova-compute[75026]: INFO nova.compute.manager [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Attaching volume 8edc5d51-750e-410a-b239-d87b34d2c6a8 to /dev/vdb
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG os_brick.utils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0828120-7805-4acb-8813-4250062e1a4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aafe4e-cd30-42af-9133-fc46fe9da6a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4abcd6-d7dd-47d5-bdbb-d6794af84f32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[943b135e-5899-4429-ba6b-ed52ea0e967a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:33:15 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:33:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea261a18-550b-4bdd-a254-b9c365791f05]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG os_brick.utils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:33:15 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Updating existing volume attachment record: 7d384ced-a93a-471c-aa0c-778e978f58b1 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzJbLSXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:33:17 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:33:17 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:33:17 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaf5758-794d-4cfb-98aa-35cb42b200d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:33:17 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13439c3-2640-4e61-a97d-b098d9523baf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567] added
Nov 10 19:33:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae406bd-f61a-4602-9aa8-32eea9c94ee2]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[82af6033-02fe-483a-aad5-a4d685c29fb5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzJbLSXQ {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzJbLSXQ" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a15a17-8e0f-45f1-a66c-8979fae202ad]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DzJbLSXQ'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e051d86e-e589-4afa-893e-7c77b6c87e5e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[700b92ba-c9e1-4347-88c3-770b653c8b9d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[418f2a7c-f870-439f-846b-b186d7545013]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567, portal: 172.16.0.220,3260]
Nov 10 19:33:18 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567, portal: 172.16.0.220,3260] successful.
Nov 10 19:33:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fdb72f-2311-4c85-835d-234038cefe17]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b950e57d-8167-42d7-b5cc-8f81942eb010]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:18 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:18 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4476b4-21b1-4276-a079-73369db621b4]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzJbLSXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23565343433313033', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565343433313033', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'flavor' on Instance uuid ccbe3f6e-3b3b-4ca7-b784-2adf16555910 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:33:19 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:33:19 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:33:19 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:33:19 user nova-compute[75026]:   <serial>ec7f9ad0-7fb2-43d4-b919-9c144cddd567</serial>
Nov 10 19:33:19 user nova-compute[75026]: </disk>
Nov 10 19:33:19 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] No VIF found with MAC fa:16:3e:14:21:dd, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea41c17c-8a39-4976-8e2d-f2085bd35f9b tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.920s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.392s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:20 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:20 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:33:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:33:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:24 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:33:24 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7782MB free_disk=25.311397552490234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5a70279-1a95-4c83-8243-b3bcb06fdbee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2f221451-f4c3-441d-8585-b0c41e18bd7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fae91f15-1f61-467f-ae81-4abf1a6c0a9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:33:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:33:25 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:33:25 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:33:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:33:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:28 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:33:28 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:30 user nova-compute[75026]: INFO nova.compute.manager [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Terminating instance
Nov 10 19:33:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-54fd3d8e-8bdb-48c4-88ec-e438afe1eebc req-3a526e3d-2ee6-47eb-83b7-34094ea9f258 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received event network-vif-unplugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-54fd3d8e-8bdb-48c4-88ec-e438afe1eebc req-3a526e3d-2ee6-47eb-83b7-34094ea9f258 service nova] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-54fd3d8e-8bdb-48c4-88ec-e438afe1eebc req-3a526e3d-2ee6-47eb-83b7-34094ea9f258 service nova] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-54fd3d8e-8bdb-48c4-88ec-e438afe1eebc req-3a526e3d-2ee6-47eb-83b7-34094ea9f258 service nova] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-54fd3d8e-8bdb-48c4-88ec-e438afe1eebc req-3a526e3d-2ee6-47eb-83b7-34094ea9f258 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] No waiting events found dispatching network-vif-unplugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-54fd3d8e-8bdb-48c4-88ec-e438afe1eebc req-3a526e3d-2ee6-47eb-83b7-34094ea9f258 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received event network-vif-unplugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:33:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Instance destroyed successfully.
Nov 10 19:33:30 user nova-compute[75026]: DEBUG nova.objects.instance [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'resources' on Instance uuid 2f221451-f4c3-441d-8585-b0c41e18bd7f {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162041140',display_name='tempest-AttachVolumeNegativeTest-server-1162041140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162041140',id=27,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwNLrBsfdzrB9MLlHXLqcwK/al2petPdIa7V9BCp/fQjFo3AzMHP9ggTjUX3+TD2XuKQD/f+Uy+y2+qgwikiNzUyVcmERVlDOgfIbfBms49x04vCPSgCFmC3zKKUrFiZA==',key_name='tempest-keypair-945191627',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-99tv57je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=2f221451-f4c3-441d-8585-b0c41e18bd7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "address": "fa:16:3e:85:30:14", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1186dc92-70", "ovs_interfaceid": "1186dc92-705f-4f17-a32c-7129cfdc0a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:30:14,bridge_name='br-int',has_traffic_filtering=True,id=1186dc92-705f-4f17-a32c-7129cfdc0a8f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1186dc92-70') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG os_vif [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:30:14,bridge_name='br-int',has_traffic_filtering=True,id=1186dc92-705f-4f17-a32c-7129cfdc0a8f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1186dc92-70') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1186dc92-70, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=558c6587-c578-4bd8-bbec-5435b515a17f) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:33:31 user nova-compute[75026]: INFO os_vif [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:30:14,bridge_name='br-int',has_traffic_filtering=True,id=1186dc92-705f-4f17-a32c-7129cfdc0a8f,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1186dc92-70')
Nov 10 19:33:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Deleting instance files /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f_del
Nov 10 19:33:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Deletion of /opt/stack/data/nova/instances/2f221451-f4c3-441d-8585-b0c41e18bd7f_del complete
Nov 10 19:33:31 user nova-compute[75026]: INFO nova.compute.manager [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 19:33:31 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:33:31 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Took 0.76 seconds to deallocate network for instance.
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-7674a534-c8bd-4ebe-8fda-26e7c59f37eb req-309836f1-2fb4-4539-80ca-1cf7fed44607 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received event network-vif-deleted-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:31 user nova-compute[75026]: INFO nova.compute.manager [req-7674a534-c8bd-4ebe-8fda-26e7c59f37eb req-309836f1-2fb4-4539-80ca-1cf7fed44607 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Neutron deleted interface 1186dc92-705f-4f17-a32c-7129cfdc0a8f; detaching it from the instance and deleting it from the info cache
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.network.neutron [req-7674a534-c8bd-4ebe-8fda-26e7c59f37eb req-309836f1-2fb4-4539-80ca-1cf7fed44607 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-7674a534-c8bd-4ebe-8fda-26e7c59f37eb req-309836f1-2fb4-4539-80ca-1cf7fed44607 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Detach interface failed, port_id=1186dc92-705f-4f17-a32c-7129cfdc0a8f, reason: Instance 2f221451-f4c3-441d-8585-b0c41e18bd7f could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:32 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:33:32 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:33:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:32 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Deleted allocations for instance 2f221451-f4c3-441d-8585-b0c41e18bd7f
Nov 10 19:33:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9298a6d-c0a5-41c4-801e-48d40d395169 tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.255s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a1dda070-1630-4f04-a412-54fce01cb6e7 req-8ccf9c76-2853-4edb-a93c-81c0f70dc118 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received event network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a1dda070-1630-4f04-a412-54fce01cb6e7 req-8ccf9c76-2853-4edb-a93c-81c0f70dc118 service nova] Acquiring lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a1dda070-1630-4f04-a412-54fce01cb6e7 req-8ccf9c76-2853-4edb-a93c-81c0f70dc118 service nova] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a1dda070-1630-4f04-a412-54fce01cb6e7 req-8ccf9c76-2853-4edb-a93c-81c0f70dc118 service nova] Lock "2f221451-f4c3-441d-8585-b0c41e18bd7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-a1dda070-1630-4f04-a412-54fce01cb6e7 req-8ccf9c76-2853-4edb-a93c-81c0f70dc118 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] No waiting events found dispatching network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:32 user nova-compute[75026]: WARNING nova.compute.manager [req-a1dda070-1630-4f04-a412-54fce01cb6e7 req-8ccf9c76-2853-4edb-a93c-81c0f70dc118 service nova] [instance: 2f221451-f4c3-441d-8585-b0c41e18bd7f] Received unexpected event network-vif-plugged-1186dc92-705f-4f17-a32c-7129cfdc0a8f for instance with vm_state deleted and task_state None.
Nov 10 19:33:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xijQJufp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:33:41 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:33:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:33:41 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:33:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:33:41 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:33:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9542583f-11b5-42b6-b87f-69e98241a3e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:33:41 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4331ccef-1108-4bf4-92c4-a72c1f1dab72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8] added
Nov 10 19:33:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f007be09-707c-4de3-a530-a61d1af80bec]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c1c79b-a737-4727-a18b-caae4eabf3fb]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xijQJufp {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xijQJufp" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b3fad1-ba3d-4fce-99e2-859b3ec56db7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xijQJufp'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a21c2-736e-4507-811e-80f1aaae8ae1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf74cf7-3c0f-4d04-be8d-0eba49e2e3c4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd79d9eb-dc46-412c-add4-77f1526aaaab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260]
Nov 10 19:33:42 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260] successful.
Nov 10 19:33:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2432de8d-f843-456e-8627-09cf8dd06a9c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b15ab0-4845-471e-b7aa-5e33d131d250]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:33:42 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3599d2-eaed-4949-a4f0-ea980ee4fd24]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:42 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xijQJufp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23533653336646530', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533653336646530', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG nova.objects.instance [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'flavor' on Instance uuid 2a333e19-c760-441d-bb5a-392d1f25b7e1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:33:43 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:33:43 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:33:43 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:33:43 user nova-compute[75026]:   <serial>8edc5d51-750e-410a-b239-d87b34d2c6a8</serial>
Nov 10 19:33:43 user nova-compute[75026]: </disk>
Nov 10 19:33:43 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No VIF found with MAC fa:16:3e:31:29:5a, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:33:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bc6b9a3a-4455-4cd8-b86b-03060988caaa tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.324s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:45 user nova-compute[75026]: INFO nova.compute.manager [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Rebuilding instance
Nov 10 19:33:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:33:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-9664026d-0a87-402f-9be9-554e09d6ad07 req-50bb21e7-c7e0-40e2-9a40-6146d76e54ac service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9664026d-0a87-402f-9be9-554e09d6ad07 req-50bb21e7-c7e0-40e2-9a40-6146d76e54ac service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9664026d-0a87-402f-9be9-554e09d6ad07 req-50bb21e7-c7e0-40e2-9a40-6146d76e54ac service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9664026d-0a87-402f-9be9-554e09d6ad07 req-50bb21e7-c7e0-40e2-9a40-6146d76e54ac service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-9664026d-0a87-402f-9be9-554e09d6ad07 req-50bb21e7-c7e0-40e2-9a40-6146d76e54ac service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:46 user nova-compute[75026]: WARNING nova.compute.manager [req-9664026d-0a87-402f-9be9-554e09d6ad07 req-50bb21e7-c7e0-40e2-9a40-6146d76e54ac service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state active and task_state rebuilding.
Nov 10 19:33:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance destroyed successfully.
Nov 10 19:33:46 user nova-compute[75026]: INFO nova.compute.manager [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Detaching volume 8edc5d51-750e-410a-b239-d87b34d2c6a8
Nov 10 19:33:46 user nova-compute[75026]: INFO nova.virt.block_device [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Attempting to driver detach volume 8edc5d51-750e-410a-b239-d87b34d2c6a8 from mountpoint /dev/vdb
Nov 10 19:33:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Attempting to detach device vdb from instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:33:46 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:33:46 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:33:46 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:33:46 user nova-compute[75026]:   <serial>8edc5d51-750e-410a-b239-d87b34d2c6a8</serial>
Nov 10 19:33:46 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:33:46 user nova-compute[75026]: </disk>
Nov 10 19:33:46 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:33:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully detached device vdb from instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 from the persistent domain config.
Nov 10 19:33:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xijQJufp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:33:46 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa678d8-9e6c-4c6b-ba00-dd80f6a7807a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:33:46 user nova-compute[75026]: No targets found.
Nov 10 19:33:46 user nova-compute[75026]: iSNS:
Nov 10 19:33:46 user nova-compute[75026]: No targets found.
Nov 10 19:33:46 user nova-compute[75026]: STATIC:
Nov 10 19:33:46 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8
Nov 10 19:33:46 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:33:46 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:33:46 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567
Nov 10 19:33:46 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:33:46 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:33:46 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:33:46 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:33:46 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:33:46 user nova-compute[75026]: FIRMWARE:
Nov 10 19:33:46 user nova-compute[75026]: No targets found.
Nov 10 19:33:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:33:46 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:33:46 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[37094368-ec0f-4341-a648-c60f811831c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[138b37b2-1a6b-4336-a2dd-c8f9294dee23]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:46 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:46 user nova-compute[75026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:33:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:46 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:46 user nova-compute[75026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:33:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda050d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fefe5a1-22c7-4fda-ad49-cb2fde80bb52]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[322b913a-2bb6-4002-8197-1cd061532fcd]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16c7d4f-a285-446c-8bd8-6b0245764eb8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[97941697-5a7b-4006-a856-278d9a7266ef]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[00739ec6-4645-4c3a-aa2c-e7ea51d8b1b1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8912e91c-6064-43d1-9ecb-1257fdea6f6c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260]
Nov 10 19:33:47 user nova-compute[75026]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260] successful.
Nov 10 19:33:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0520b0-ae55-4fc3-9a0d-49792ab76c59]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== disconnect_volume: return (301ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:33:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:33:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-297bb16d-d73f-48ac-a7b4-bf759f7649a6 req-ee9e6db7-140a-4d7c-8f4f-d5b7e3e19e72 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-297bb16d-d73f-48ac-a7b4-bf759f7649a6 req-ee9e6db7-140a-4d7c-8f4f-d5b7e3e19e72 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-297bb16d-d73f-48ac-a7b4-bf759f7649a6 req-ee9e6db7-140a-4d7c-8f4f-d5b7e3e19e72 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-297bb16d-d73f-48ac-a7b4-bf759f7649a6 req-ee9e6db7-140a-4d7c-8f4f-d5b7e3e19e72 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-297bb16d-d73f-48ac-a7b4-bf759f7649a6 req-ee9e6db7-140a-4d7c-8f4f-d5b7e3e19e72 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:48 user nova-compute[75026]: WARNING nova.compute.manager [req-297bb16d-d73f-48ac-a7b4-bf759f7649a6 req-ee9e6db7-140a-4d7c-8f4f-d5b7e3e19e72 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state active and task_state rebuilding.
Nov 10 19:33:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:50 user nova-compute[75026]: INFO nova.compute.manager [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Terminating instance
Nov 10 19:33:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-42bbbc07-2763-42b8-958c-df7f69fb9a37 req-10a70c5e-4c9d-4539-9240-9d28a46f70ea service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received event network-vif-unplugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-42bbbc07-2763-42b8-958c-df7f69fb9a37 req-10a70c5e-4c9d-4539-9240-9d28a46f70ea service nova] Acquiring lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-42bbbc07-2763-42b8-958c-df7f69fb9a37 req-10a70c5e-4c9d-4539-9240-9d28a46f70ea service nova] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-42bbbc07-2763-42b8-958c-df7f69fb9a37 req-10a70c5e-4c9d-4539-9240-9d28a46f70ea service nova] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-42bbbc07-2763-42b8-958c-df7f69fb9a37 req-10a70c5e-4c9d-4539-9240-9d28a46f70ea service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] No waiting events found dispatching network-vif-unplugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-42bbbc07-2763-42b8-958c-df7f69fb9a37 req-10a70c5e-4c9d-4539-9240-9d28a46f70ea service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received event network-vif-unplugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:33:50 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Instance destroyed successfully.
Nov 10 19:33:50 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lazy-loading 'resources' on Instance uuid fae91f15-1f61-467f-ae81-4abf1a6c0a9a {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2100545023',display_name='tempest-VolumesActionsTest-instance-2100545023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2100545023',id=30,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4399f5415c44727be21445bbee1bc1b',ramdisk_id='',reservation_id='r-22ggladl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1070572732',owner_user_name='tempest-VolumesActionsTest-1070572732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:32:07Z,user_data=None,user_id='fe3a0de9e0cb4826967417d8f29fe839',uuid=fae91f15-1f61-467f-ae81-4abf1a6c0a9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converting VIF {"id": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "address": "fa:16:3e:00:f8:c5", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d78a32e-df", "ovs_interfaceid": "3d78a32e-df9e-41c1-84ec-9cb24996d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d78a32e-df9e-41c1-84ec-9cb24996d9a7,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d78a32e-df') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG os_vif [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d78a32e-df9e-41c1-84ec-9cb24996d9a7,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d78a32e-df') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d78a32e-df, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5055c4f6-92bd-425c-bc56-a1980b4cdc7a) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:51 user nova-compute[75026]: INFO os_vif [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=3d78a32e-df9e-41c1-84ec-9cb24996d9a7,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d78a32e-df')
Nov 10 19:33:51 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Deleting instance files /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a_del
Nov 10 19:33:51 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Deletion of /opt/stack/data/nova/instances/fae91f15-1f61-467f-ae81-4abf1a6c0a9a_del complete
Nov 10 19:33:51 user nova-compute[75026]: INFO nova.compute.manager [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 19:33:51 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:33:51 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Took 0.40 seconds to deallocate network for instance.
Nov 10 19:33:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-80222703-884e-434f-b334-b4a9953560f7 req-c9fa8888-be77-4285-b740-2391e0ea4b54 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received event network-vif-deleted-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:51 user nova-compute[75026]: INFO nova.compute.manager [req-80222703-884e-434f-b334-b4a9953560f7 req-c9fa8888-be77-4285-b740-2391e0ea4b54 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Neutron deleted interface 3d78a32e-df9e-41c1-84ec-9cb24996d9a7; detaching it from the instance and deleting it from the info cache
Nov 10 19:33:51 user nova-compute[75026]: DEBUG nova.network.neutron [req-80222703-884e-434f-b334-b4a9953560f7 req-c9fa8888-be77-4285-b740-2391e0ea4b54 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-80222703-884e-434f-b334-b4a9953560f7 req-c9fa8888-be77-4285-b740-2391e0ea4b54 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Detach interface failed, port_id=3d78a32e-df9e-41c1-84ec-9cb24996d9a7, reason: Instance fae91f15-1f61-467f-ae81-4abf1a6c0a9a could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:33:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:51 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Deleted allocations for instance fae91f15-1f61-467f-ae81-4abf1a6c0a9a
Nov 10 19:33:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4d02474b-b754-494f-bf1e-1d16ec7fc091 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.840s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-cb51aff1-0c82-4318-9b31-3b40d809ba0a req-1175ec07-0f75-495a-8f69-0d69055f5400 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received event network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cb51aff1-0c82-4318-9b31-3b40d809ba0a req-1175ec07-0f75-495a-8f69-0d69055f5400 service nova] Acquiring lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cb51aff1-0c82-4318-9b31-3b40d809ba0a req-1175ec07-0f75-495a-8f69-0d69055f5400 service nova] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-cb51aff1-0c82-4318-9b31-3b40d809ba0a req-1175ec07-0f75-495a-8f69-0d69055f5400 service nova] Lock "fae91f15-1f61-467f-ae81-4abf1a6c0a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-cb51aff1-0c82-4318-9b31-3b40d809ba0a req-1175ec07-0f75-495a-8f69-0d69055f5400 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] No waiting events found dispatching network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:52 user nova-compute[75026]: WARNING nova.compute.manager [req-cb51aff1-0c82-4318-9b31-3b40d809ba0a req-1175ec07-0f75-495a-8f69-0d69055f5400 service nova] [instance: fae91f15-1f61-467f-ae81-4abf1a6c0a9a] Received unexpected event network-vif-plugged-3d78a32e-df9e-41c1-84ec-9cb24996d9a7 for instance with vm_state deleted and task_state None.
Nov 10 19:33:54 user nova-compute[75026]: INFO nova.compute.manager [None req-fad598ff-8b81-4229-b499-9ba406121f86 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Unrescuing
Nov 10 19:33:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fad598ff-8b81-4229-b499-9ba406121f86 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:33:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fad598ff-8b81-4229-b499-9ba406121f86 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquired lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:33:54 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fad598ff-8b81-4229-b499-9ba406121f86 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fad598ff-8b81-4229-b499-9ba406121f86 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fad598ff-8b81-4229-b499-9ba406121f86 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Releasing lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fad598ff-8b81-4229-b499-9ba406121f86 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'flavor' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-148781b1-65bb-4108-8972-59ae0f149870 req-91b4fca0-82cf-4780-8f69-1aa37a1ca39b service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-148781b1-65bb-4108-8972-59ae0f149870 req-91b4fca0-82cf-4780-8f69-1aa37a1ca39b service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-148781b1-65bb-4108-8972-59ae0f149870 req-91b4fca0-82cf-4780-8f69-1aa37a1ca39b service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-148781b1-65bb-4108-8972-59ae0f149870 req-91b4fca0-82cf-4780-8f69-1aa37a1ca39b service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-148781b1-65bb-4108-8972-59ae0f149870 req-91b4fca0-82cf-4780-8f69-1aa37a1ca39b service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:55 user nova-compute[75026]: WARNING nova.compute.manager [req-148781b1-65bb-4108-8972-59ae0f149870 req-91b4fca0-82cf-4780-8f69-1aa37a1ca39b service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:33:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:56 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance destroyed successfully.
Nov 10 19:33:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-15317474',display_name='tempest-ServerActionsTestOtherA-server-555049719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-15317474',id=29,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANKbmnJLhIy/JKEN3OUfXLEG+Pdi5x/Nbfoi2d/gtVja3l6VtbaoyIkgBlAg41imqPAl5Eg9ZNth0ngB2O9LrKDF6yeH1SbrpemISX9AjOc/LDw0Q1j8cyQSpAhDjhMLg==',key_name='tempest-keypair-614238469',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-r30cb6r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=2a333e19-c760-441d-bb5a-392d1f25b7e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_vif [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc38295a-d9, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:56 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance destroyed successfully.
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83bd6ed7-c4ae-4b06-971d-4fbf0081fdf3) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:56 user nova-compute[75026]: INFO os_vif [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9')
Nov 10 19:33:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xijQJufp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:33:56 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17f4b81-9161-45e0-a637-8f0c4bfa6b7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:33:56 user nova-compute[75026]: No targets found.
Nov 10 19:33:56 user nova-compute[75026]: iSNS:
Nov 10 19:33:56 user nova-compute[75026]: No targets found.
Nov 10 19:33:56 user nova-compute[75026]: STATIC:
Nov 10 19:33:56 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567
Nov 10 19:33:56 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:33:56 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:33:56 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:33:56 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:33:56 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:33:56 user nova-compute[75026]: FIRMWARE:
Nov 10 19:33:56 user nova-compute[75026]: No targets found.
Nov 10 19:33:56 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:33:56 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:33:56 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aae585-d745-46da-9d04-7b8ca8c5cb05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[46da5c12-176a-438e-936c-e3b78087682b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:56 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:56 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:33:56 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:33:56 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed983d85e0>, {}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Disconnecting from: [] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== disconnect_volume: return (79ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:33:56 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Deleting instance files /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1_del
Nov 10 19:33:56 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Deletion of /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1_del complete
Nov 10 19:33:56 user nova-compute[75026]: INFO nova.virt.block_device [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Booting with volume 8edc5d51-750e-410a-b239-d87b34d2c6a8 at /dev/vdb
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.utils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[430882ab-4ecc-46d5-a94f-b2f374149382]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac3caf4-25a6-4530-a5da-a4d18ab9c57d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[683ff907-7bb2-4048-9a52-310de1263e8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9770e010-609a-44a4-ab16-796c57048aed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:33:56 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:33:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d473765-d67c-45fa-a453-a0dad048525c]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG os_brick.utils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:33:56 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Updating existing volume attachment record: cb80a630-26c1-411c-ad67-9589263e6587 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:57 user nova-compute[75026]: WARNING nova.compute.manager [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:33:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:57 user nova-compute[75026]: WARNING nova.compute.manager [req-20a95444-93e6-485e-abb1-c011313774e7 req-e3f8fca3-6e51-478d-8d94-c92059ec83c8 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:33:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:33:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-a0008277-8455-4af6-9434-ad7c3137d965 req-fb073bf9-ca69-4524-9f90-9b48378f0385 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:33:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a0008277-8455-4af6-9434-ad7c3137d965 req-fb073bf9-ca69-4524-9f90-9b48378f0385 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:33:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a0008277-8455-4af6-9434-ad7c3137d965 req-fb073bf9-ca69-4524-9f90-9b48378f0385 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:33:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a0008277-8455-4af6-9434-ad7c3137d965 req-fb073bf9-ca69-4524-9f90-9b48378f0385 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:33:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-a0008277-8455-4af6-9434-ad7c3137d965 req-fb073bf9-ca69-4524-9f90-9b48378f0385 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:33:59 user nova-compute[75026]: WARNING nova.compute.manager [req-a0008277-8455-4af6-9434-ad7c3137d965 req-fb073bf9-ca69-4524-9f90-9b48378f0385 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:34:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fad598ff-8b81-4229-b499-9ba406121f86 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:34:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:34:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:34:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:34:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:34:19 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:34:20 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updating instance_info_cache with network_info: [{"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:34:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-b5a70279-1a95-4c83-8243-b3bcb06fdbee" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:34:20 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:34:20 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:20 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:34:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:23 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:34:23 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8276MB free_disk=25.384204864501953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5a70279-1a95-4c83-8243-b3bcb06fdbee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:34:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.368s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:34:24 user nova-compute[75026]: INFO nova.compute.claims [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Claim successful on node user
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:34:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.policy [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a44857fb02f843df95883ee2b5daf3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a491b667d34c4a9f991e2d7d29099671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:34:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Creating image(s)
Nov 10 19:34:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "/opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "/opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "/opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk 1073741824" returned: 0 in 0.046s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Successfully created port: 18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.213s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Cannot resize image /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Ensure instance console log exists: /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Successfully updated port: 18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquired lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-b7bb5911-ebb8-40db-a7b7-b3f170efd739 req-37f735e1-fc87-461e-bcde-7b1ddb121f58 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received event network-changed-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-b7bb5911-ebb8-40db-a7b7-b3f170efd739 req-37f735e1-fc87-461e-bcde-7b1ddb121f58 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Refreshing instance network info cache due to event network-changed-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b7bb5911-ebb8-40db-a7b7-b3f170efd739 req-37f735e1-fc87-461e-bcde-7b1ddb121f58 service nova] Acquiring lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Updating instance_info_cache with network_info: [{"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Releasing lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Instance network_info: |[{"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b7bb5911-ebb8-40db-a7b7-b3f170efd739 req-37f735e1-fc87-461e-bcde-7b1ddb121f58 service nova] Acquired lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-b7bb5911-ebb8-40db-a7b7-b3f170efd739 req-37f735e1-fc87-461e-bcde-7b1ddb121f58 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Refreshing network info cache for port 18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Start _get_guest_xml network_info=[{"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:34:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:34:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-324061038',display_name='tempest-AttachVolumeNegativeTest-server-324061038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-324061038',id=31,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGzGNidniTxPYQS3CwAyK236iVImeyN1gJxb0lxeYP24/r227FjCYyKUqPuWYDG2axZPRByu7GaHgTM8LHmA3q/zRj9SzrDKqfKjpJRVOhxLHmjRvNuuToi7btOK5ghsg==',key_name='tempest-keypair-1096075716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-vweoodbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:34:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=4aa0a40a-b7ed-43b9-84c4-130af672d1b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:d7:e2,bridge_name='br-int',has_traffic_filtering=True,id=18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fe908a-fc') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'pci_devices' on Instance uuid 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:34:26 user nova-compute[75026]:   <uuid>4aa0a40a-b7ed-43b9-84c4-130af672d1b1</uuid>
Nov 10 19:34:26 user nova-compute[75026]:   <name>instance-0000001f</name>
Nov 10 19:34:26 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:34:26 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:34:26 user nova-compute[75026]:   <metadata>
Nov 10 19:34:26 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:34:26 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:34:26 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeNegativeTest-server-324061038</nova:name>
Nov 10 19:34:26 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:34:26</nova:creationTime>
Nov 10 19:34:26 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:34:26 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:34:26 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:34:26 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:34:26 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:34:26 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:34:26 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:34:26 user nova-compute[75026]:       <nova:owner>
Nov 10 19:34:26 user nova-compute[75026]:         <nova:user uuid="a44857fb02f843df95883ee2b5daf3ce">tempest-AttachVolumeNegativeTest-1780662801-project-member</nova:user>
Nov 10 19:34:26 user nova-compute[75026]:         <nova:project uuid="a491b667d34c4a9f991e2d7d29099671">tempest-AttachVolumeNegativeTest-1780662801</nova:project>
Nov 10 19:34:26 user nova-compute[75026]:       </nova:owner>
Nov 10 19:34:26 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:34:26 user nova-compute[75026]:       <nova:ports>
Nov 10 19:34:26 user nova-compute[75026]:         <nova:port uuid="18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d">
Nov 10 19:34:26 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 19:34:26 user nova-compute[75026]:         </nova:port>
Nov 10 19:34:26 user nova-compute[75026]:       </nova:ports>
Nov 10 19:34:26 user nova-compute[75026]:     </nova:instance>
Nov 10 19:34:26 user nova-compute[75026]:   </metadata>
Nov 10 19:34:26 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:34:26 user nova-compute[75026]:     <system>
Nov 10 19:34:26 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:34:26 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:34:26 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:34:26 user nova-compute[75026]:       <entry name="serial">4aa0a40a-b7ed-43b9-84c4-130af672d1b1</entry>
Nov 10 19:34:26 user nova-compute[75026]:       <entry name="uuid">4aa0a40a-b7ed-43b9-84c4-130af672d1b1</entry>
Nov 10 19:34:26 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:34:26 user nova-compute[75026]:     </system>
Nov 10 19:34:26 user nova-compute[75026]:   </sysinfo>
Nov 10 19:34:26 user nova-compute[75026]:   <os>
Nov 10 19:34:26 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:34:26 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:34:26 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:34:26 user nova-compute[75026]:   </os>
Nov 10 19:34:26 user nova-compute[75026]:   <features>
Nov 10 19:34:26 user nova-compute[75026]:     <acpi/>
Nov 10 19:34:26 user nova-compute[75026]:     <apic/>
Nov 10 19:34:26 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:34:26 user nova-compute[75026]:   </features>
Nov 10 19:34:26 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:34:26 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:34:26 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:34:26 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:34:26 user nova-compute[75026]:   </clock>
Nov 10 19:34:26 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:34:26 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:34:26 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:34:26 user nova-compute[75026]:   </cpu>
Nov 10 19:34:26 user nova-compute[75026]:   <devices>
Nov 10 19:34:26 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:34:26 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:34:26 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk"/>
Nov 10 19:34:26 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:34:26 user nova-compute[75026]:     </disk>
Nov 10 19:34:26 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:34:26 user nova-compute[75026]:       <mac address="fa:16:3e:10:d7:e2"/>
Nov 10 19:34:26 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:34:26 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:34:26 user nova-compute[75026]:       <target dev="tap18fe908a-fc"/>
Nov 10 19:34:26 user nova-compute[75026]:     </interface>
Nov 10 19:34:26 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:34:26 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/console.log" append="off"/>
Nov 10 19:34:26 user nova-compute[75026]:     </serial>
Nov 10 19:34:26 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:34:26 user nova-compute[75026]:     <video>
Nov 10 19:34:26 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:34:26 user nova-compute[75026]:     </video>
Nov 10 19:34:26 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:34:26 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:34:26 user nova-compute[75026]:     </rng>
Nov 10 19:34:26 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:34:26 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:34:26 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:34:26 user nova-compute[75026]:     </memballoon>
Nov 10 19:34:26 user nova-compute[75026]:   </devices>
Nov 10 19:34:26 user nova-compute[75026]: </domain>
Nov 10 19:34:26 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-324061038',display_name='tempest-AttachVolumeNegativeTest-server-324061038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-324061038',id=31,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGzGNidniTxPYQS3CwAyK236iVImeyN1gJxb0lxeYP24/r227FjCYyKUqPuWYDG2axZPRByu7GaHgTM8LHmA3q/zRj9SzrDKqfKjpJRVOhxLHmjRvNuuToi7btOK5ghsg==',key_name='tempest-keypair-1096075716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-vweoodbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:34:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=4aa0a40a-b7ed-43b9-84c4-130af672d1b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:d7:e2,bridge_name='br-int',has_traffic_filtering=True,id=18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fe908a-fc') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG os_vif [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d7:e2,bridge_name='br-int',has_traffic_filtering=True,id=18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fe908a-fc') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aeadedb4-1af4-5962-87a9-4cb5496a6a5a', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18fe908a-fc, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18fe908a-fc, col_values=(('qos', UUID('f4e507c0-a006-4a1a-8615-42ebb65ad5c5')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18fe908a-fc, col_values=(('external_ids', {'iface-id': '18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:d7:e2', 'vm-uuid': '4aa0a40a-b7ed-43b9-84c4-130af672d1b1'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:27 user nova-compute[75026]: INFO os_vif [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d7:e2,bridge_name='br-int',has_traffic_filtering=True,id=18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fe908a-fc')
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No VIF found with MAC fa:16:3e:10:d7:e2, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:34:27 user nova-compute[75026]: INFO nova.compute.claims [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Claim successful on node user
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-b7bb5911-ebb8-40db-a7b7-b3f170efd739 req-37f735e1-fc87-461e-bcde-7b1ddb121f58 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Updated VIF entry in instance network info cache for port 18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-b7bb5911-ebb8-40db-a7b7-b3f170efd739 req-37f735e1-fc87-461e-bcde-7b1ddb121f58 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Updating instance_info_cache with network_info: [{"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b7bb5911-ebb8-40db-a7b7-b3f170efd739 req-37f735e1-fc87-461e-bcde-7b1ddb121f58 service nova] Releasing lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:34:27 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:34:27 user nova-compute[75026]: DEBUG nova.policy [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '758478b59f94467898696fa7af7cd630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e509e662d27146fba4f51fd55dbe6f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:34:27 user nova-compute[75026]: INFO nova.virt.block_device [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Booting with volume 3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 at /dev/vda
Nov 10 19:34:28 user nova-compute[75026]: DEBUG os_brick.utils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c09792-ec80-4d9b-bacc-eeb239c262e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[88289b54-773a-4fd9-834e-3f96eb31dab4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab16cb9-0210-461c-9ec6-7edbec684ad5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0552a7-bf7b-4796-9dca-f058890330b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:34:28 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e4fed-11e2-41e9-8b3b-6aec50159ad3]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG os_brick.utils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Updating existing volume attachment record: adf9e863-ec93-42da-b8ee-a2eccac60ee5 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-b861e428-b0d4-49c3-8833-b3f3e6f86d27 req-2d60943b-b079-4924-a2fc-e57b1784bfbc service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received event network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b861e428-b0d4-49c3-8833-b3f3e6f86d27 req-2d60943b-b079-4924-a2fc-e57b1784bfbc service nova] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b861e428-b0d4-49c3-8833-b3f3e6f86d27 req-2d60943b-b079-4924-a2fc-e57b1784bfbc service nova] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b861e428-b0d4-49c3-8833-b3f3e6f86d27 req-2d60943b-b079-4924-a2fc-e57b1784bfbc service nova] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-b861e428-b0d4-49c3-8833-b3f3e6f86d27 req-2d60943b-b079-4924-a2fc-e57b1784bfbc service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] No waiting events found dispatching network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:34:28 user nova-compute[75026]: WARNING nova.compute.manager [req-b861e428-b0d4-49c3-8833-b3f3e6f86d27 req-2d60943b-b079-4924-a2fc-e57b1784bfbc service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received unexpected event network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d for instance with vm_state building and task_state spawning.
Nov 10 19:34:28 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Successfully created port: 2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Successfully updated port: 2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquired lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-09928acb-724c-458b-b812-b3cb0a2e6b5a req-07905dac-4793-49eb-9736-93967323a515 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received event network-changed-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-09928acb-724c-458b-b812-b3cb0a2e6b5a req-07905dac-4793-49eb-9736-93967323a515 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Refreshing instance network info cache due to event network-changed-2deedd57-160c-4589-8e9a-bdcc4005b408. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09928acb-724c-458b-b812-b3cb0a2e6b5a req-07905dac-4793-49eb-9736-93967323a515 service nova] Acquiring lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Updating instance_info_cache with network_info: [{"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Releasing lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Instance network_info: |[{"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09928acb-724c-458b-b812-b3cb0a2e6b5a req-07905dac-4793-49eb-9736-93967323a515 service nova] Acquired lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:34:29 user nova-compute[75026]: DEBUG nova.network.neutron [req-09928acb-724c-458b-b812-b3cb0a2e6b5a req-07905dac-4793-49eb-9736-93967323a515 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Refreshing network info cache for port 2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-09928acb-724c-458b-b812-b3cb0a2e6b5a req-07905dac-4793-49eb-9736-93967323a515 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Updated VIF entry in instance network info cache for port 2deedd57-160c-4589-8e9a-bdcc4005b408. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-09928acb-724c-458b-b812-b3cb0a2e6b5a req-07905dac-4793-49eb-9736-93967323a515 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Updating instance_info_cache with network_info: [{"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-09928acb-724c-458b-b812-b3cb0a2e6b5a req-07905dac-4793-49eb-9736-93967323a515 service nova] Releasing lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-bdad6693-9e01-49ad-ba5b-a41d918f3103 req-8d05f1d8-39c4-4980-9373-8db8638893c8 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received event network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bdad6693-9e01-49ad-ba5b-a41d918f3103 req-8d05f1d8-39c4-4980-9373-8db8638893c8 service nova] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bdad6693-9e01-49ad-ba5b-a41d918f3103 req-8d05f1d8-39c4-4980-9373-8db8638893c8 service nova] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-bdad6693-9e01-49ad-ba5b-a41d918f3103 req-8d05f1d8-39c4-4980-9373-8db8638893c8 service nova] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-bdad6693-9e01-49ad-ba5b-a41d918f3103 req-8d05f1d8-39c4-4980-9373-8db8638893c8 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] No waiting events found dispatching network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:34:30 user nova-compute[75026]: WARNING nova.compute.manager [req-bdad6693-9e01-49ad-ba5b-a41d918f3103 req-8d05f1d8-39c4-4980-9373-8db8638893c8 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received unexpected event network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d for instance with vm_state building and task_state spawning.
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:34:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Instance spawned successfully.
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:30 user nova-compute[75026]: INFO nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 10 19:34:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:34:31 user nova-compute[75026]: INFO nova.compute.manager [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Took 7.14 seconds to build instance.
Nov 10 19:34:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fbd5fb9b-2644-46a0-8d2f-09fb84b901da tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.238s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:34:37 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Creating image(s)
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk 1073741824" returned: 0 in 0.050s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:37 user nova-compute[75026]: INFO nova.compute.manager [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Detaching volume ec7f9ad0-7fb2-43d4-b919-9c144cddd567
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.224s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:37 user nova-compute[75026]: INFO nova.virt.block_device [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Attempting to driver detach volume ec7f9ad0-7fb2-43d4-b919-9c144cddd567 from mountpoint /dev/vdb
Nov 10 19:34:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Attempting to detach device vdb from instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:34:37 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:34:37 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:34:37 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:34:37 user nova-compute[75026]:   <serial>ec7f9ad0-7fb2-43d4-b919-9c144cddd567</serial>
Nov 10 19:34:37 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:34:37 user nova-compute[75026]: </disk>
Nov 10 19:34:37 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:37 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Successfully detached device vdb from instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 from the persistent domain config.
Nov 10 19:34:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:34:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:34:37 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:34:37 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:34:37 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:34:37 user nova-compute[75026]:   <serial>ec7f9ad0-7fb2-43d4-b919-9c144cddd567</serial>
Nov 10 19:34:37 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:34:37 user nova-compute[75026]: </disk>
Nov 10 19:34:37 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Cannot resize image /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Ensure instance console log exists: /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Start _get_guest_xml network_info=[{"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'cb80a630-26c1-411c-ad67-9589263e6587', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xijQJufp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a333e19-c760-441d-bb5a-392d1f25b7e1', 'attached_at': '', 'detached_at': '', 'volume_id': '8edc5d51-750e-410a-b239-d87b34d2c6a8', 'serial': '8edc5d51-750e-410a-b239-d87b34d2c6a8'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:34:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 19:34:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a333e19-c760-441d-bb5a-392d1f25b7e1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xijQJufp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:34:38 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:34:38 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:34:38 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed375652-7714-4406-a4d3-bd23f89d2600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:34:38 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee700992-f7f7-4120-aa5d-1bd0e3cebd1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8] added
Nov 10 19:34:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4012c1c5-597e-4d90-882c-650b23cb87a0]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a507d35-ef08-4667-9e29-6f069ab9ac0b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xijQJufp {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xijQJufp" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b2fcfd-9a43-41e5-b2e6-882d8d77ec1b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xijQJufp'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b62de8-1791-441b-a14c-bda4c49a147b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[004f56c7-d691-4d4e-bf30-52f1140e891e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a4204c-98ae-4947-b49e-fd5bb2415c5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260]
Nov 10 19:34:38 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260] successful.
Nov 10 19:34:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[504c73c8-ef1a-406f-8e6d-14b1efce1c19]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbe8db0-637c-420b-ac9c-9baa42bd2490]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:34:38 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9650abc7-327d-4ad6-9600-3481fd3ecab4]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:34:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xijQJufp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23533653336646530', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533653336646530', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-15317474',display_name='tempest-ServerActionsTestOtherA-server-555049719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-15317474',id=29,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANKbmnJLhIy/JKEN3OUfXLEG+Pdi5x/Nbfoi2d/gtVja3l6VtbaoyIkgBlAg41imqPAl5Eg9ZNth0ngB2O9LrKDF6yeH1SbrpemISX9AjOc/LDw0Q1j8cyQSpAhDjhMLg==',key_name='tempest-keypair-614238469',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-r30cb6r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=2a333e19-c760-441d-bb5a-392d1f25b7e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:34:39 user nova-compute[75026]:   <uuid>2a333e19-c760-441d-bb5a-392d1f25b7e1</uuid>
Nov 10 19:34:39 user nova-compute[75026]:   <name>instance-0000001d</name>
Nov 10 19:34:39 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:34:39 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:34:39 user nova-compute[75026]:   <metadata>
Nov 10 19:34:39 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:34:39 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:34:39 user nova-compute[75026]:       <nova:name>tempest-ServerActionsTestOtherA-server-555049719</nova:name>
Nov 10 19:34:39 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:34:38</nova:creationTime>
Nov 10 19:34:39 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:34:39 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:34:39 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:34:39 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:34:39 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:34:39 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:34:39 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:34:39 user nova-compute[75026]:       <nova:owner>
Nov 10 19:34:39 user nova-compute[75026]:         <nova:user uuid="b4fcc097fff34ad2b2cc532d269e06bb">tempest-ServerActionsTestOtherA-664805234-project-member</nova:user>
Nov 10 19:34:39 user nova-compute[75026]:         <nova:project uuid="cdef98b8144148229b82888b888d88c5">tempest-ServerActionsTestOtherA-664805234</nova:project>
Nov 10 19:34:39 user nova-compute[75026]:       </nova:owner>
Nov 10 19:34:39 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:34:39 user nova-compute[75026]:       <nova:ports>
Nov 10 19:34:39 user nova-compute[75026]:         <nova:port uuid="fc38295a-d9ab-42e2-83c7-8623dc67f022">
Nov 10 19:34:39 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 19:34:39 user nova-compute[75026]:         </nova:port>
Nov 10 19:34:39 user nova-compute[75026]:       </nova:ports>
Nov 10 19:34:39 user nova-compute[75026]:     </nova:instance>
Nov 10 19:34:39 user nova-compute[75026]:   </metadata>
Nov 10 19:34:39 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:34:39 user nova-compute[75026]:     <system>
Nov 10 19:34:39 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:34:39 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:34:39 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:34:39 user nova-compute[75026]:       <entry name="serial">2a333e19-c760-441d-bb5a-392d1f25b7e1</entry>
Nov 10 19:34:39 user nova-compute[75026]:       <entry name="uuid">2a333e19-c760-441d-bb5a-392d1f25b7e1</entry>
Nov 10 19:34:39 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:34:39 user nova-compute[75026]:     </system>
Nov 10 19:34:39 user nova-compute[75026]:   </sysinfo>
Nov 10 19:34:39 user nova-compute[75026]:   <os>
Nov 10 19:34:39 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:34:39 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:34:39 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:34:39 user nova-compute[75026]:   </os>
Nov 10 19:34:39 user nova-compute[75026]:   <features>
Nov 10 19:34:39 user nova-compute[75026]:     <acpi/>
Nov 10 19:34:39 user nova-compute[75026]:     <apic/>
Nov 10 19:34:39 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:34:39 user nova-compute[75026]:   </features>
Nov 10 19:34:39 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:34:39 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:34:39 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:34:39 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:34:39 user nova-compute[75026]:   </clock>
Nov 10 19:34:39 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:34:39 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:34:39 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:34:39 user nova-compute[75026]:   </cpu>
Nov 10 19:34:39 user nova-compute[75026]:   <devices>
Nov 10 19:34:39 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:34:39 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:34:39 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk"/>
Nov 10 19:34:39 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:34:39 user nova-compute[75026]:     </disk>
Nov 10 19:34:39 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:34:39 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:34:39 user nova-compute[75026]:       <source dev="/dev/sdc"/>
Nov 10 19:34:39 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:34:39 user nova-compute[75026]:       <serial>8edc5d51-750e-410a-b239-d87b34d2c6a8</serial>
Nov 10 19:34:39 user nova-compute[75026]:     </disk>
Nov 10 19:34:39 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:34:39 user nova-compute[75026]:       <mac address="fa:16:3e:31:29:5a"/>
Nov 10 19:34:39 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:34:39 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:34:39 user nova-compute[75026]:       <target dev="tapfc38295a-d9"/>
Nov 10 19:34:39 user nova-compute[75026]:     </interface>
Nov 10 19:34:39 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:34:39 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/console.log" append="off"/>
Nov 10 19:34:39 user nova-compute[75026]:     </serial>
Nov 10 19:34:39 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:34:39 user nova-compute[75026]:     <video>
Nov 10 19:34:39 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:34:39 user nova-compute[75026]:     </video>
Nov 10 19:34:39 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:34:39 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:34:39 user nova-compute[75026]:     </rng>
Nov 10 19:34:39 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:34:39 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:34:39 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:34:39 user nova-compute[75026]:     </memballoon>
Nov 10 19:34:39 user nova-compute[75026]:   </devices>
Nov 10 19:34:39 user nova-compute[75026]: </domain>
Nov 10 19:34:39 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-15317474',display_name='tempest-ServerActionsTestOtherA-server-555049719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-15317474',id=29,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANKbmnJLhIy/JKEN3OUfXLEG+Pdi5x/Nbfoi2d/gtVja3l6VtbaoyIkgBlAg41imqPAl5Eg9ZNth0ngB2O9LrKDF6yeH1SbrpemISX9AjOc/LDw0Q1j8cyQSpAhDjhMLg==',key_name='tempest-keypair-614238469',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-r30cb6r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=2a333e19-c760-441d-bb5a-392d1f25b7e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG os_vif [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69d10d65-9e47-5f35-a546-de5595dcf7a7', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc38295a-d9, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc38295a-d9, col_values=(('qos', UUID('a14b0f66-80ad-497c-ac60-3c3d1be67e2b')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc38295a-d9, col_values=(('external_ids', {'iface-id': 'fc38295a-d9ab-42e2-83c7-8623dc67f022', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:29:5a', 'vm-uuid': '2a333e19-c760-441d-bb5a-392d1f25b7e1'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:39 user nova-compute[75026]: INFO os_vif [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9')
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:34:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No VIF found with MAC fa:16:3e:31:29:5a, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-f01bd14f-6c49-429e-b5d3-b8fd51b7d220 req-edec3d4c-5580-43c6-b460-93be7efe3ac4 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f01bd14f-6c49-429e-b5d3-b8fd51b7d220 req-edec3d4c-5580-43c6-b460-93be7efe3ac4 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f01bd14f-6c49-429e-b5d3-b8fd51b7d220 req-edec3d4c-5580-43c6-b460-93be7efe3ac4 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f01bd14f-6c49-429e-b5d3-b8fd51b7d220 req-edec3d4c-5580-43c6-b460-93be7efe3ac4 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-f01bd14f-6c49-429e-b5d3-b8fd51b7d220 req-edec3d4c-5580-43c6-b460-93be7efe3ac4 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:34:41 user nova-compute[75026]: WARNING nova.compute.manager [req-f01bd14f-6c49-429e-b5d3-b8fd51b7d220 req-edec3d4c-5580-43c6-b460-93be7efe3ac4 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 19:34:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:34:42 user nova-compute[75026]: INFO nova.compute.claims [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Claim successful on node user
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:34:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.policy [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3a0de9e0cb4826967417d8f29fe839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4399f5415c44727be21445bbee1bc1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:34:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Creating image(s)
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "/opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "/opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "/opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.199s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk 1073741824" returned: 0 in 0.062s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-56baa086-8a9b-42f5-a61f-60939b0a21c6 req-1560ae6f-fa2d-41a6-9b0c-425f91565bcc service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-56baa086-8a9b-42f5-a61f-60939b0a21c6 req-1560ae6f-fa2d-41a6-9b0c-425f91565bcc service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-56baa086-8a9b-42f5-a61f-60939b0a21c6 req-1560ae6f-fa2d-41a6-9b0c-425f91565bcc service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-56baa086-8a9b-42f5-a61f-60939b0a21c6 req-1560ae6f-fa2d-41a6-9b0c-425f91565bcc service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-56baa086-8a9b-42f5-a61f-60939b0a21c6 req-1560ae6f-fa2d-41a6-9b0c-425f91565bcc service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:34:43 user nova-compute[75026]: WARNING nova.compute.manager [req-56baa086-8a9b-42f5-a61f-60939b0a21c6 req-1560ae6f-fa2d-41a6-9b0c-425f91565bcc service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:34:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance spawned successfully.
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.201s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Successfully created port: 034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Cannot resize image /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Ensure instance console log exists: /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75026) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd01f584-5e7b-4af8-b228-c73b481fe832 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Successfully updated port: 034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "refresh_cache-2cb39412-b6de-4fa7-b720-8c20ac7c25fc" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquired lock "refresh_cache-2cb39412-b6de-4fa7-b720-8c20ac7c25fc" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-720e09d5-6673-4f80-be74-3bc347599b32 req-080a2afb-42f7-488d-a104-19316970288b service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received event network-changed-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-720e09d5-6673-4f80-be74-3bc347599b32 req-080a2afb-42f7-488d-a104-19316970288b service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Refreshing instance network info cache due to event network-changed-034f80c3-8578-4405-898a-8b4c1d9412e2. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-720e09d5-6673-4f80-be74-3bc347599b32 req-080a2afb-42f7-488d-a104-19316970288b service nova] Acquiring lock "refresh_cache-2cb39412-b6de-4fa7-b720-8c20ac7c25fc" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Updating instance_info_cache with network_info: [{"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Releasing lock "refresh_cache-2cb39412-b6de-4fa7-b720-8c20ac7c25fc" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Instance network_info: |[{"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-720e09d5-6673-4f80-be74-3bc347599b32 req-080a2afb-42f7-488d-a104-19316970288b service nova] Acquired lock "refresh_cache-2cb39412-b6de-4fa7-b720-8c20ac7c25fc" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-720e09d5-6673-4f80-be74-3bc347599b32 req-080a2afb-42f7-488d-a104-19316970288b service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Refreshing network info cache for port 034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Start _get_guest_xml network_info=[{"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:34:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1507033356',display_name='tempest-VolumesActionsTest-instance-1507033356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1507033356',id=33,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4399f5415c44727be21445bbee1bc1b',ramdisk_id='',reservation_id='r-og7v0dvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1070572732',owner_user_name='tempest-VolumesActionsTest-1070572732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:34:43Z,user_data=None,user_id='fe3a0de9e0cb4826967417d8f29fe839',uuid=2cb39412-b6de-4fa7-b720-8c20ac7c25fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converting VIF {"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=034f80c3-8578-4405-898a-8b4c1d9412e2,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034f80c3-85') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cb39412-b6de-4fa7-b720-8c20ac7c25fc {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:34:44 user nova-compute[75026]:   <uuid>2cb39412-b6de-4fa7-b720-8c20ac7c25fc</uuid>
Nov 10 19:34:44 user nova-compute[75026]:   <name>instance-00000021</name>
Nov 10 19:34:44 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:34:44 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:34:44 user nova-compute[75026]:   <metadata>
Nov 10 19:34:44 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:34:44 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:34:44 user nova-compute[75026]:       <nova:name>tempest-VolumesActionsTest-instance-1507033356</nova:name>
Nov 10 19:34:44 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:34:44</nova:creationTime>
Nov 10 19:34:44 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:34:44 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:34:44 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:34:44 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:34:44 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:34:44 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:34:44 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:34:44 user nova-compute[75026]:       <nova:owner>
Nov 10 19:34:44 user nova-compute[75026]:         <nova:user uuid="fe3a0de9e0cb4826967417d8f29fe839">tempest-VolumesActionsTest-1070572732-project-member</nova:user>
Nov 10 19:34:44 user nova-compute[75026]:         <nova:project uuid="a4399f5415c44727be21445bbee1bc1b">tempest-VolumesActionsTest-1070572732</nova:project>
Nov 10 19:34:44 user nova-compute[75026]:       </nova:owner>
Nov 10 19:34:44 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:34:44 user nova-compute[75026]:       <nova:ports>
Nov 10 19:34:44 user nova-compute[75026]:         <nova:port uuid="034f80c3-8578-4405-898a-8b4c1d9412e2">
Nov 10 19:34:44 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 19:34:44 user nova-compute[75026]:         </nova:port>
Nov 10 19:34:44 user nova-compute[75026]:       </nova:ports>
Nov 10 19:34:44 user nova-compute[75026]:     </nova:instance>
Nov 10 19:34:44 user nova-compute[75026]:   </metadata>
Nov 10 19:34:44 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:34:44 user nova-compute[75026]:     <system>
Nov 10 19:34:44 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:34:44 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:34:44 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:34:44 user nova-compute[75026]:       <entry name="serial">2cb39412-b6de-4fa7-b720-8c20ac7c25fc</entry>
Nov 10 19:34:44 user nova-compute[75026]:       <entry name="uuid">2cb39412-b6de-4fa7-b720-8c20ac7c25fc</entry>
Nov 10 19:34:44 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:34:44 user nova-compute[75026]:     </system>
Nov 10 19:34:44 user nova-compute[75026]:   </sysinfo>
Nov 10 19:34:44 user nova-compute[75026]:   <os>
Nov 10 19:34:44 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:34:44 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:34:44 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:34:44 user nova-compute[75026]:   </os>
Nov 10 19:34:44 user nova-compute[75026]:   <features>
Nov 10 19:34:44 user nova-compute[75026]:     <acpi/>
Nov 10 19:34:44 user nova-compute[75026]:     <apic/>
Nov 10 19:34:44 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:34:44 user nova-compute[75026]:   </features>
Nov 10 19:34:44 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:34:44 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:34:44 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:34:44 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:34:44 user nova-compute[75026]:   </clock>
Nov 10 19:34:44 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:34:44 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:34:44 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:34:44 user nova-compute[75026]:   </cpu>
Nov 10 19:34:44 user nova-compute[75026]:   <devices>
Nov 10 19:34:44 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:34:44 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:34:44 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk"/>
Nov 10 19:34:44 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:34:44 user nova-compute[75026]:     </disk>
Nov 10 19:34:44 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:34:44 user nova-compute[75026]:       <mac address="fa:16:3e:5b:b9:ea"/>
Nov 10 19:34:44 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:34:44 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:34:44 user nova-compute[75026]:       <target dev="tap034f80c3-85"/>
Nov 10 19:34:44 user nova-compute[75026]:     </interface>
Nov 10 19:34:44 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:34:44 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/console.log" append="off"/>
Nov 10 19:34:44 user nova-compute[75026]:     </serial>
Nov 10 19:34:44 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:34:44 user nova-compute[75026]:     <video>
Nov 10 19:34:44 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:34:44 user nova-compute[75026]:     </video>
Nov 10 19:34:44 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:34:44 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:34:44 user nova-compute[75026]:     </rng>
Nov 10 19:34:44 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:34:44 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:34:44 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:34:44 user nova-compute[75026]:     </memballoon>
Nov 10 19:34:44 user nova-compute[75026]:   </devices>
Nov 10 19:34:44 user nova-compute[75026]: </domain>
Nov 10 19:34:44 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1507033356',display_name='tempest-VolumesActionsTest-instance-1507033356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1507033356',id=33,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4399f5415c44727be21445bbee1bc1b',ramdisk_id='',reservation_id='r-og7v0dvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1070572732',owner_user_name='tempest-VolumesActionsTest-1070572732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:34:43Z,user_data=None,user_id='fe3a0de9e0cb4826967417d8f29fe839',uuid=2cb39412-b6de-4fa7-b720-8c20ac7c25fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converting VIF {"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=034f80c3-8578-4405-898a-8b4c1d9412e2,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034f80c3-85') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG os_vif [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=034f80c3-8578-4405-898a-8b4c1d9412e2,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034f80c3-85') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '475f5936-bef8-5444-9f63-fa6bc9da774b', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap034f80c3-85, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap034f80c3-85, col_values=(('qos', UUID('3a10d878-f47b-45b9-b4d3-810f4b7af455')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap034f80c3-85, col_values=(('external_ids', {'iface-id': '034f80c3-8578-4405-898a-8b4c1d9412e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:b9:ea', 'vm-uuid': '2cb39412-b6de-4fa7-b720-8c20ac7c25fc'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:44 user nova-compute[75026]: INFO os_vif [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=034f80c3-8578-4405-898a-8b4c1d9412e2,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034f80c3-85')
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] No VIF found with MAC fa:16:3e:5b:b9:ea, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-720e09d5-6673-4f80-be74-3bc347599b32 req-080a2afb-42f7-488d-a104-19316970288b service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Updated VIF entry in instance network info cache for port 034f80c3-8578-4405-898a-8b4c1d9412e2. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:34:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-720e09d5-6673-4f80-be74-3bc347599b32 req-080a2afb-42f7-488d-a104-19316970288b service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Updating instance_info_cache with network_info: [{"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:34:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-720e09d5-6673-4f80-be74-3bc347599b32 req-080a2afb-42f7-488d-a104-19316970288b service nova] Releasing lock "refresh_cache-2cb39412-b6de-4fa7-b720-8c20ac7c25fc" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-99ada9ad-0704-4f84-97ad-ebcf0066dad6 req-5b35b25e-14ef-4676-9da6-0bcef9d7fafe service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received event network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-99ada9ad-0704-4f84-97ad-ebcf0066dad6 req-5b35b25e-14ef-4676-9da6-0bcef9d7fafe service nova] Acquiring lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-99ada9ad-0704-4f84-97ad-ebcf0066dad6 req-5b35b25e-14ef-4676-9da6-0bcef9d7fafe service nova] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-99ada9ad-0704-4f84-97ad-ebcf0066dad6 req-5b35b25e-14ef-4676-9da6-0bcef9d7fafe service nova] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-99ada9ad-0704-4f84-97ad-ebcf0066dad6 req-5b35b25e-14ef-4676-9da6-0bcef9d7fafe service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] No waiting events found dispatching network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:34:46 user nova-compute[75026]: WARNING nova.compute.manager [req-99ada9ad-0704-4f84-97ad-ebcf0066dad6 req-5b35b25e-14ef-4676-9da6-0bcef9d7fafe service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received unexpected event network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 for instance with vm_state building and task_state spawning.
Nov 10 19:34:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-949ada56-af41-42f1-b80a-6eadee4209bf req-705b2d79-f2c2-4f0a-846a-22060882fee3 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received event network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-949ada56-af41-42f1-b80a-6eadee4209bf req-705b2d79-f2c2-4f0a-846a-22060882fee3 service nova] Acquiring lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-949ada56-af41-42f1-b80a-6eadee4209bf req-705b2d79-f2c2-4f0a-846a-22060882fee3 service nova] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-949ada56-af41-42f1-b80a-6eadee4209bf req-705b2d79-f2c2-4f0a-846a-22060882fee3 service nova] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-949ada56-af41-42f1-b80a-6eadee4209bf req-705b2d79-f2c2-4f0a-846a-22060882fee3 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] No waiting events found dispatching network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:34:48 user nova-compute[75026]: WARNING nova.compute.manager [req-949ada56-af41-42f1-b80a-6eadee4209bf req-705b2d79-f2c2-4f0a-846a-22060882fee3 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received unexpected event network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 for instance with vm_state building and task_state spawning.
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:34:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Instance spawned successfully.
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:34:48 user nova-compute[75026]: INFO nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 10 19:34:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:34:48 user nova-compute[75026]: INFO nova.compute.manager [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Took 6.74 seconds to build instance.
Nov 10 19:34:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3a317606-2ee2-4620-8ea0-48b3690eeab9 tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.873s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:34:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:58 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 is timed out.
Nov 10 19:34:58 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Successfully detached device vdb from instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910 from the live domain config.
Nov 10 19:34:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzJbLSXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:34:58 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e0ac3-cad9-494a-92cb-6fd782a712fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:34:58 user nova-compute[75026]: No targets found.
Nov 10 19:34:58 user nova-compute[75026]: iSNS:
Nov 10 19:34:58 user nova-compute[75026]: No targets found.
Nov 10 19:34:58 user nova-compute[75026]: STATIC:
Nov 10 19:34:58 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8
Nov 10 19:34:58 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:34:58 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:34:58 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567
Nov 10 19:34:58 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:34:58 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:34:58 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:34:58 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:34:58 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:34:58 user nova-compute[75026]: FIRMWARE:
Nov 10 19:34:58 user nova-compute[75026]: No targets found.
Nov 10 19:34:58 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:34:58 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:34:58 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d1ba7a-a397-4d8f-a5b0-5172259383aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57a864-b6f0-444f-b64f-af8d4be54beb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:34:58 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:34:58 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:34:58 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:34:58 user nova-compute[75026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 (non-flash)
Nov 10 19:34:58 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:34:58 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda050df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27523bf-16c5-4fcb-a3ea-1433e4050ff3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd002b1-f39a-4d4f-98f9-695e9d5150dd]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ac2360-1507-4327-8121-6a54085b0ff5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9cfe27-3173-422c-a3ee-91fc878ca30d]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[424e35d6-606d-48aa-8f90-18bf8707629c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fb4351-5c4d-4709-975b-13b5ceda4906]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567, portal: 172.16.0.220,3260]
Nov 10 19:34:58 user nova-compute[75026]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567, portal: 172.16.0.220,3260] successful.
Nov 10 19:34:58 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[457cac43-ce16-4b65-aeba-499d2f45a20b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] <== disconnect_volume: return (306ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:34:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:34:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'flavor' on Instance uuid ccbe3f6e-3b3b-4ca7-b784-2adf16555910 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7000b0a-10e6-43e8-9c48-614ba5f7a220 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.685s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 25.527s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:03 user nova-compute[75026]: INFO nova.compute.manager [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Terminating instance
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:35:03 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Creating image(s)
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Ensure instance console log exists: /opt/stack/data/nova/instances/8dfd6aaa-ef1b-4acb-a473-f17c59991f3f/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Start _get_guest_xml network_info=[{"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'adf9e863-ec93-42da-b8ee-a2eccac60ee5', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUWqNMgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8dfd6aaa-ef1b-4acb-a473-f17c59991f3f', 'attached_at': '', 'detached_at': '', 'volume_id': '3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'serial': '3aa29c9f-2950-435a-bbe9-293b5a1f6bc0'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:35:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:35:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUWqNMgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:35:03 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:35:03 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:35:03 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-534976ff-f65e-4ef9-8165-7f4459fd6ff7 req-a1495612-8f5b-4e64-b66c-b92ebf831b93 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received event network-vif-unplugged-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-534976ff-f65e-4ef9-8165-7f4459fd6ff7 req-a1495612-8f5b-4e64-b66c-b92ebf831b93 service nova] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-534976ff-f65e-4ef9-8165-7f4459fd6ff7 req-a1495612-8f5b-4e64-b66c-b92ebf831b93 service nova] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-534976ff-f65e-4ef9-8165-7f4459fd6ff7 req-a1495612-8f5b-4e64-b66c-b92ebf831b93 service nova] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-534976ff-f65e-4ef9-8165-7f4459fd6ff7 req-a1495612-8f5b-4e64-b66c-b92ebf831b93 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] No waiting events found dispatching network-vif-unplugged-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-534976ff-f65e-4ef9-8165-7f4459fd6ff7 req-a1495612-8f5b-4e64-b66c-b92ebf831b93 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received event network-vif-unplugged-f4916190-3b62-43b2-a609-5671b8392ccc for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d4dc9-8523-4f96-849d-39e166a7d9d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:35:03 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d66456-b5bb-4e3f-a272-960cbdba07cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0] added
Nov 10 19:35:03 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[075ed529-f484-43cf-bfe3-5fd08812d573]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[638718fc-28aa-4ec7-972a-ec0748bed9f1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUWqNMgc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUWqNMgc" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef749a7-ddd8-45a2-a9da-6da1054ddf39]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUWqNMgc'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4dc5e3-7e54-448f-884f-038c4a6765c2]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dfa276-8084-4b78-a594-f0fc488ff964]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:35:03 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:35:03 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:35:03 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:35:03 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf8345-46c5-41f0-9ae1-ce698143e25e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260]
Nov 10 19:35:03 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260] successful.
Nov 10 19:35:03 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:35:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d13ebe-6889-4609-ba6a-d71b0637d4b6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb51e25-509f-40bf-8db0-4222b6dfc8c7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:35:04 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:35:04 user nova-compute[75026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:35:04 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:35:04 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:35:04 user nova-compute[75026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:35:04 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a11ba59-69c0-49dc-beba-0934e91e97df]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUWqNMgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:35:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Instance destroyed successfully.
Nov 10 19:35:04 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lazy-loading 'resources' on Instance uuid ccbe3f6e-3b3b-4ca7-b784-2adf16555910 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1035596564',display_name='tempest-VolumesSnapshotTestJSON-instance-1035596564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1035596564',id=28,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs6Usy80yhL2/2dYReKOn8oyS5SsAtnL2yWJCnLjrq3WzVX6n5EFAJYrx/xxt9/fUebKYlc5tE1/kbppTTt/KZiUjcTDkrBGtWQeR35cyPCGoiL9R6Ow8BF6Yak5fIYzQ==',key_name='tempest-keypair-1559493376',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50ae442a2faf4481a3fb87b1c7ea53bf',ramdisk_id='',reservation_id='r-bea6p7yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1891642589',owner_user_name='tempest-VolumesSnapshotTestJSON-1891642589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:31:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f95e8bc5971d4c06b6755ad1f63c6856',uuid=ccbe3f6e-3b3b-4ca7-b784-2adf16555910,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converting VIF {"id": "f4916190-3b62-43b2-a609-5671b8392ccc", "address": "fa:16:3e:14:21:dd", "network": {"id": "7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1829369871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50ae442a2faf4481a3fb87b1c7ea53bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4916190-3b", "ovs_interfaceid": "f4916190-3b62-43b2-a609-5671b8392ccc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:21:dd,bridge_name='br-int',has_traffic_filtering=True,id=f4916190-3b62-43b2-a609-5671b8392ccc,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4916190-3b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_vif [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:21:dd,bridge_name='br-int',has_traffic_filtering=True,id=f4916190-3b62-43b2-a609-5671b8392ccc,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4916190-3b') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4916190-3b, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a58dcad4-12ee-4e78-b422-1329cb3f75b8) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:04 user nova-compute[75026]: INFO os_vif [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:21:dd,bridge_name='br-int',has_traffic_filtering=True,id=f4916190-3b62-43b2-a609-5671b8392ccc,network=Network(7e7c5ac6-ab0d-4f9f-961e-fa9d2d18e2e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4916190-3b')
Nov 10 19:35:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzJbLSXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:35:04 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:35:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23964386433323235', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964386433323235', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.682s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb2a738-4238-4c50-90b0-a274a01cd029]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:35:05 user nova-compute[75026]: No targets found.
Nov 10 19:35:05 user nova-compute[75026]: iSNS:
Nov 10 19:35:05 user nova-compute[75026]: No targets found.
Nov 10 19:35:05 user nova-compute[75026]: STATIC:
Nov 10 19:35:05 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0
Nov 10 19:35:05 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:35:05 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:35:05 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8
Nov 10 19:35:05 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:35:05 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:35:05 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:35:05 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:35:05 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:35:05 user nova-compute[75026]: FIRMWARE:
Nov 10 19:35:05 user nova-compute[75026]: No targets found.
Nov 10 19:35:05 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:35:05 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:35:05 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec7f9ad0-7fb2-43d4-b919-9c144cddd567', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1397075974',display_name='tempest-TestVolumeBootPattern-server-1397075974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1397075974',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-0817f8y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:34:28Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=8dfd6aaa-ef1b-4acb-a473-f17c59991f3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=2deedd57-160c-4589-8e9a-bdcc4005b408,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2deedd57-16') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.objects.instance [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b0473-2705-41a3-9bda-1cacbd9b7265]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:35:05 user nova-compute[75026]:   <uuid>8dfd6aaa-ef1b-4acb-a473-f17c59991f3f</uuid>
Nov 10 19:35:05 user nova-compute[75026]:   <name>instance-00000020</name>
Nov 10 19:35:05 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:35:05 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:35:05 user nova-compute[75026]:   <metadata>
Nov 10 19:35:05 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:35:05 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:35:05 user nova-compute[75026]:       <nova:name>tempest-TestVolumeBootPattern-server-1397075974</nova:name>
Nov 10 19:35:05 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:35:03</nova:creationTime>
Nov 10 19:35:05 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:35:05 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:35:05 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:35:05 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:35:05 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:35:05 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:35:05 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:35:05 user nova-compute[75026]:       <nova:owner>
Nov 10 19:35:05 user nova-compute[75026]:         <nova:user uuid="758478b59f94467898696fa7af7cd630">tempest-TestVolumeBootPattern-1182723443-project-member</nova:user>
Nov 10 19:35:05 user nova-compute[75026]:         <nova:project uuid="e509e662d27146fba4f51fd55dbe6f83">tempest-TestVolumeBootPattern-1182723443</nova:project>
Nov 10 19:35:05 user nova-compute[75026]:       </nova:owner>
Nov 10 19:35:05 user nova-compute[75026]:       <nova:ports>
Nov 10 19:35:05 user nova-compute[75026]:         <nova:port uuid="2deedd57-160c-4589-8e9a-bdcc4005b408">
Nov 10 19:35:05 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:35:05 user nova-compute[75026]:         </nova:port>
Nov 10 19:35:05 user nova-compute[75026]:       </nova:ports>
Nov 10 19:35:05 user nova-compute[75026]:     </nova:instance>
Nov 10 19:35:05 user nova-compute[75026]:   </metadata>
Nov 10 19:35:05 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:35:05 user nova-compute[75026]:     <system>
Nov 10 19:35:05 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:35:05 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:35:05 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:35:05 user nova-compute[75026]:       <entry name="serial">8dfd6aaa-ef1b-4acb-a473-f17c59991f3f</entry>
Nov 10 19:35:05 user nova-compute[75026]:       <entry name="uuid">8dfd6aaa-ef1b-4acb-a473-f17c59991f3f</entry>
Nov 10 19:35:05 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:35:05 user nova-compute[75026]:     </system>
Nov 10 19:35:05 user nova-compute[75026]:   </sysinfo>
Nov 10 19:35:05 user nova-compute[75026]:   <os>
Nov 10 19:35:05 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:35:05 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:35:05 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:35:05 user nova-compute[75026]:   </os>
Nov 10 19:35:05 user nova-compute[75026]:   <features>
Nov 10 19:35:05 user nova-compute[75026]:     <acpi/>
Nov 10 19:35:05 user nova-compute[75026]:     <apic/>
Nov 10 19:35:05 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:35:05 user nova-compute[75026]:   </features>
Nov 10 19:35:05 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:35:05 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:35:05 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:35:05 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:35:05 user nova-compute[75026]:   </clock>
Nov 10 19:35:05 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:35:05 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:35:05 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:35:05 user nova-compute[75026]:   </cpu>
Nov 10 19:35:05 user nova-compute[75026]:   <devices>
Nov 10 19:35:05 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:35:05 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:35:05 user nova-compute[75026]:       <source dev="/dev/sdb"/>
Nov 10 19:35:05 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:35:05 user nova-compute[75026]:       <serial>3aa29c9f-2950-435a-bbe9-293b5a1f6bc0</serial>
Nov 10 19:35:05 user nova-compute[75026]:     </disk>
Nov 10 19:35:05 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:35:05 user nova-compute[75026]:       <mac address="fa:16:3e:56:e4:fe"/>
Nov 10 19:35:05 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:35:05 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:35:05 user nova-compute[75026]:       <target dev="tap2deedd57-16"/>
Nov 10 19:35:05 user nova-compute[75026]:     </interface>
Nov 10 19:35:05 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:35:05 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/8dfd6aaa-ef1b-4acb-a473-f17c59991f3f/console.log" append="off"/>
Nov 10 19:35:05 user nova-compute[75026]:     </serial>
Nov 10 19:35:05 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:35:05 user nova-compute[75026]:     <video>
Nov 10 19:35:05 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:35:05 user nova-compute[75026]:     </video>
Nov 10 19:35:05 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:35:05 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:35:05 user nova-compute[75026]:     </rng>
Nov 10 19:35:05 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:35:05 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:35:05 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:35:05 user nova-compute[75026]:     </memballoon>
Nov 10 19:35:05 user nova-compute[75026]:   </devices>
Nov 10 19:35:05 user nova-compute[75026]: </domain>
Nov 10 19:35:05 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1397075974',display_name='tempest-TestVolumeBootPattern-server-1397075974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1397075974',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-0817f8y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:34:28Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=8dfd6aaa-ef1b-4acb-a473-f17c59991f3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=2deedd57-160c-4589-8e9a-bdcc4005b408,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2deedd57-16') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_vif [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=2deedd57-160c-4589-8e9a-bdcc4005b408,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2deedd57-16') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8ff876e-a96c-514e-a379-8792f73425cf', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[857abe0a-d1e2-455a-ab59-5c59c1a6d1bb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:35:05 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:35:05 user nova-compute[75026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:35:05 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:35:05 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:35:05 user nova-compute[75026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:35:05 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed983380d0>, {}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Disconnecting from: [] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] <== disconnect_volume: return (765ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:35:05 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Deleting instance files /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910_del
Nov 10 19:35:05 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Deletion of /opt/stack/data/nova/instances/ccbe3f6e-3b3b-4ca7-b784-2adf16555910_del complete
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2deedd57-16, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2deedd57-16, col_values=(('qos', UUID('3b4d28ce-7831-477e-aa31-192a97c581c6')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2deedd57-16, col_values=(('external_ids', {'iface-id': '2deedd57-160c-4589-8e9a-bdcc4005b408', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:e4:fe', 'vm-uuid': '8dfd6aaa-ef1b-4acb-a473-f17c59991f3f'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:05 user nova-compute[75026]: INFO os_vif [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=2deedd57-160c-4589-8e9a-bdcc4005b408,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2deedd57-16')
Nov 10 19:35:05 user nova-compute[75026]: INFO nova.compute.manager [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Took 1.82 seconds to destroy the instance on the hypervisor.
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No VIF found with MAC fa:16:3e:56:e4:fe, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-71b52425-ed87-4257-bd47-990cb6442316 req-a008fa24-4bc4-4bce-9c8d-8c4da98f0a98 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received event network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71b52425-ed87-4257-bd47-990cb6442316 req-a008fa24-4bc4-4bce-9c8d-8c4da98f0a98 service nova] Acquiring lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71b52425-ed87-4257-bd47-990cb6442316 req-a008fa24-4bc4-4bce-9c8d-8c4da98f0a98 service nova] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-71b52425-ed87-4257-bd47-990cb6442316 req-a008fa24-4bc4-4bce-9c8d-8c4da98f0a98 service nova] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-71b52425-ed87-4257-bd47-990cb6442316 req-a008fa24-4bc4-4bce-9c8d-8c4da98f0a98 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] No waiting events found dispatching network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:35:05 user nova-compute[75026]: WARNING nova.compute.manager [req-71b52425-ed87-4257-bd47-990cb6442316 req-a008fa24-4bc4-4bce-9c8d-8c4da98f0a98 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received unexpected event network-vif-plugged-f4916190-3b62-43b2-a609-5671b8392ccc for instance with vm_state active and task_state deleting.
Nov 10 19:35:06 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:35:06 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Took 0.84 seconds to deallocate network for instance.
Nov 10 19:35:06 user nova-compute[75026]: WARNING nova.volume.cinder [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Attachment b0e62ec0-384f-4b64-92c9-a0829f2009da does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b0e62ec0-384f-4b64-92c9-a0829f2009da. (HTTP 404) (Request-ID: req-5be36450-4d2b-452d-a98a-c522bac8f4b1)
Nov 10 19:35:06 user nova-compute[75026]: INFO nova.compute.manager [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 19:35:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:06 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Deleted allocations for instance ccbe3f6e-3b3b-4ca7-b784-2adf16555910
Nov 10 19:35:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5412d24d-9d5a-4eea-8357-ca5e65246ac6 tempest-VolumesSnapshotTestJSON-1891642589 tempest-VolumesSnapshotTestJSON-1891642589-project-member] Lock "ccbe3f6e-3b3b-4ca7-b784-2adf16555910" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.279s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-26d87d8c-6214-4fc4-93e5-af14b71dbd2b req-9a9dfbf2-87cb-40db-aceb-17fc998c1dc9 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received event network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26d87d8c-6214-4fc4-93e5-af14b71dbd2b req-9a9dfbf2-87cb-40db-aceb-17fc998c1dc9 service nova] Acquiring lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26d87d8c-6214-4fc4-93e5-af14b71dbd2b req-9a9dfbf2-87cb-40db-aceb-17fc998c1dc9 service nova] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26d87d8c-6214-4fc4-93e5-af14b71dbd2b req-9a9dfbf2-87cb-40db-aceb-17fc998c1dc9 service nova] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-26d87d8c-6214-4fc4-93e5-af14b71dbd2b req-9a9dfbf2-87cb-40db-aceb-17fc998c1dc9 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] No waiting events found dispatching network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:35:06 user nova-compute[75026]: WARNING nova.compute.manager [req-26d87d8c-6214-4fc4-93e5-af14b71dbd2b req-9a9dfbf2-87cb-40db-aceb-17fc998c1dc9 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received unexpected event network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 for instance with vm_state building and task_state spawning.
Nov 10 19:35:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-950bad86-c79e-4749-873f-e5f9b8dbe373 req-170a198f-0730-431d-b5de-f74479405e47 service nova] [instance: ccbe3f6e-3b3b-4ca7-b784-2adf16555910] Received event network-vif-deleted-f4916190-3b62-43b2-a609-5671b8392ccc {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:35:08 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Instance spawned successfully.
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:08 user nova-compute[75026]: INFO nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-95da0601-0e5a-4a68-b30e-cc8c8ef252c1 req-d6cac1ad-a9ce-4e3f-87ce-4a1c561754a3 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received event network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-95da0601-0e5a-4a68-b30e-cc8c8ef252c1 req-d6cac1ad-a9ce-4e3f-87ce-4a1c561754a3 service nova] Acquiring lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-95da0601-0e5a-4a68-b30e-cc8c8ef252c1 req-d6cac1ad-a9ce-4e3f-87ce-4a1c561754a3 service nova] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-95da0601-0e5a-4a68-b30e-cc8c8ef252c1 req-d6cac1ad-a9ce-4e3f-87ce-4a1c561754a3 service nova] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-95da0601-0e5a-4a68-b30e-cc8c8ef252c1 req-d6cac1ad-a9ce-4e3f-87ce-4a1c561754a3 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] No waiting events found dispatching network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:35:08 user nova-compute[75026]: WARNING nova.compute.manager [req-95da0601-0e5a-4a68-b30e-cc8c8ef252c1 req-d6cac1ad-a9ce-4e3f-87ce-4a1c561754a3 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received unexpected event network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 for instance with vm_state active and task_state None.
Nov 10 19:35:08 user nova-compute[75026]: INFO nova.compute.manager [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Took 41.70 seconds to build instance.
Nov 10 19:35:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3fd3f9da-f847-4d3a-af5b-9d3d31e02fe6 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.801s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:35:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:24 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:35:24 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7714MB free_disk=25.307205200195312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5a70279-1a95-4c83-8243-b3bcb06fdbee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2cb39412-b6de-4fa7-b720-8c20ac7c25fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:35:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:35:25 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:35:25 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:35:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:35:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:28 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:35:28 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:35:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:39 user nova-compute[75026]: INFO nova.compute.manager [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Terminating instance
Nov 10 19:35:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-73d9edd7-56ed-4786-acc5-cc3c55f05e66 req-5adf5f45-72dc-402f-a9e5-f64940be8ac9 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received event network-vif-unplugged-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-73d9edd7-56ed-4786-acc5-cc3c55f05e66 req-5adf5f45-72dc-402f-a9e5-f64940be8ac9 service nova] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-73d9edd7-56ed-4786-acc5-cc3c55f05e66 req-5adf5f45-72dc-402f-a9e5-f64940be8ac9 service nova] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-73d9edd7-56ed-4786-acc5-cc3c55f05e66 req-5adf5f45-72dc-402f-a9e5-f64940be8ac9 service nova] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-73d9edd7-56ed-4786-acc5-cc3c55f05e66 req-5adf5f45-72dc-402f-a9e5-f64940be8ac9 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] No waiting events found dispatching network-vif-unplugged-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:35:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-73d9edd7-56ed-4786-acc5-cc3c55f05e66 req-5adf5f45-72dc-402f-a9e5-f64940be8ac9 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received event network-vif-unplugged-22634108-429f-42b5-ab70-28176c1b589a for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:35:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Instance destroyed successfully.
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.objects.instance [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lazy-loading 'resources' on Instance uuid b5a70279-1a95-4c83-8243-b3bcb06fdbee {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1605904584',display_name='tempest-ServerStableDeviceRescueTest-server-1605904584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1605904584',id=24,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSdwHKJUeYG8sDoV5OqB9TAcSuKxvE2IVMxCyOUvMucy6EStHG2Tw31KP9+xxKh51c4av7wLyjfW2cDvfoBi8Tx18YMLlshaALCN8nidevqNhXsYM1WxKoiiWGifFbm8w==',key_name='tempest-keypair-1048311316',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:28:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92d8f53cedda41f7b122c5d70ba7c3e7',ramdisk_id='',reservation_id='r-qnljx7a8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1163467638',owner_user_name='tempest-ServerStableDeviceRescueTest-1163467638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23cdc917bddc43489c11d252cde89f0c',uuid=b5a70279-1a95-4c83-8243-b3bcb06fdbee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Converting VIF {"id": "22634108-429f-42b5-ab70-28176c1b589a", "address": "fa:16:3e:8a:2a:6f", "network": {"id": "b50a3bd7-62f0-409c-b7e7-07e8fffa3097", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1997717054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92d8f53cedda41f7b122c5d70ba7c3e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22634108-42", "ovs_interfaceid": "22634108-429f-42b5-ab70-28176c1b589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:2a:6f,bridge_name='br-int',has_traffic_filtering=True,id=22634108-429f-42b5-ab70-28176c1b589a,network=Network(b50a3bd7-62f0-409c-b7e7-07e8fffa3097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22634108-42') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG os_vif [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:2a:6f,bridge_name='br-int',has_traffic_filtering=True,id=22634108-429f-42b5-ab70-28176c1b589a,network=Network(b50a3bd7-62f0-409c-b7e7-07e8fffa3097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22634108-42') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22634108-42, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=041767e4-777f-4815-bb63-8cbd5aa8f492) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:40 user nova-compute[75026]: INFO os_vif [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:2a:6f,bridge_name='br-int',has_traffic_filtering=True,id=22634108-429f-42b5-ab70-28176c1b589a,network=Network(b50a3bd7-62f0-409c-b7e7-07e8fffa3097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22634108-42')
Nov 10 19:35:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Deleting instance files /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee_del
Nov 10 19:35:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Deletion of /opt/stack/data/nova/instances/b5a70279-1a95-4c83-8243-b3bcb06fdbee_del complete
Nov 10 19:35:40 user nova-compute[75026]: INFO nova.compute.manager [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 10 19:35:40 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:35:40 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Took 0.60 seconds to deallocate network for instance.
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-32aff193-322f-4398-86aa-b9e239abc44e req-3388f3f3-0b89-4cbd-abd0-6606fa88c696 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received event network-vif-deleted-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:40 user nova-compute[75026]: INFO nova.compute.manager [req-32aff193-322f-4398-86aa-b9e239abc44e req-3388f3f3-0b89-4cbd-abd0-6606fa88c696 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Neutron deleted interface 22634108-429f-42b5-ab70-28176c1b589a; detaching it from the instance and deleting it from the info cache
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.network.neutron [req-32aff193-322f-4398-86aa-b9e239abc44e req-3388f3f3-0b89-4cbd-abd0-6606fa88c696 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-32aff193-322f-4398-86aa-b9e239abc44e req-3388f3f3-0b89-4cbd-abd0-6606fa88c696 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Detach interface failed, port_id=22634108-429f-42b5-ab70-28176c1b589a, reason: Instance b5a70279-1a95-4c83-8243-b3bcb06fdbee could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:41 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:35:41 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:35:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:41 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Deleted allocations for instance b5a70279-1a95-4c83-8243-b3bcb06fdbee
Nov 10 19:35:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a8260694-4899-434d-8e34-a6b9ff03e40b tempest-ServerStableDeviceRescueTest-1163467638 tempest-ServerStableDeviceRescueTest-1163467638-project-member] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.748s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-88c78231-237d-4e94-8db0-1e7734f8933b req-bfb5174b-0776-4e78-848b-28abe487eca3 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received event network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-88c78231-237d-4e94-8db0-1e7734f8933b req-bfb5174b-0776-4e78-848b-28abe487eca3 service nova] Acquiring lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-88c78231-237d-4e94-8db0-1e7734f8933b req-bfb5174b-0776-4e78-848b-28abe487eca3 service nova] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-88c78231-237d-4e94-8db0-1e7734f8933b req-bfb5174b-0776-4e78-848b-28abe487eca3 service nova] Lock "b5a70279-1a95-4c83-8243-b3bcb06fdbee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-88c78231-237d-4e94-8db0-1e7734f8933b req-bfb5174b-0776-4e78-848b-28abe487eca3 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] No waiting events found dispatching network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:35:41 user nova-compute[75026]: WARNING nova.compute.manager [req-88c78231-237d-4e94-8db0-1e7734f8933b req-bfb5174b-0776-4e78-848b-28abe487eca3 service nova] [instance: b5a70279-1a95-4c83-8243-b3bcb06fdbee] Received unexpected event network-vif-plugged-22634108-429f-42b5-ab70-28176c1b589a for instance with vm_state deleted and task_state None.
Nov 10 19:35:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "468562be-d411-4da2-bf90-7cb2b1edacca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:35:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:35:46 user nova-compute[75026]: INFO nova.compute.claims [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Claim successful on node user
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:35:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.policy [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcbd2be26ec84b5d9f6f6638963e870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e468483e8f4f70bd228ff8194d76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:35:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Creating image(s)
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "/opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "/opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "/opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Successfully created port: 3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk 1073741824" returned: 0 in 0.054s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Cannot resize image /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Ensure instance console log exists: /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Successfully updated port: 3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquired lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-e075f2fa-d6ce-46e8-bcc9-6c068b8e5d98 req-f990e4b5-19b0-4ca0-8ced-a3acee2d1dcb service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-changed-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-e075f2fa-d6ce-46e8-bcc9-6c068b8e5d98 req-f990e4b5-19b0-4ca0-8ced-a3acee2d1dcb service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Refreshing instance network info cache due to event network-changed-3de4734a-85d3-455d-a53d-a30e9bea20c2. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e075f2fa-d6ce-46e8-bcc9-6c068b8e5d98 req-f990e4b5-19b0-4ca0-8ced-a3acee2d1dcb service nova] Acquiring lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Updating instance_info_cache with network_info: [{"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Releasing lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Instance network_info: |[{"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e075f2fa-d6ce-46e8-bcc9-6c068b8e5d98 req-f990e4b5-19b0-4ca0-8ced-a3acee2d1dcb service nova] Acquired lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.neutron [req-e075f2fa-d6ce-46e8-bcc9-6c068b8e5d98 req-f990e4b5-19b0-4ca0-8ced-a3acee2d1dcb service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Refreshing network info cache for port 3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Start _get_guest_xml network_info=[{"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:35:48 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:35:48 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-752617559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-752617559',id=34,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-06msk51f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:35:47Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=468562be-d411-4da2-bf90-7cb2b1edacca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:28:35,bridge_name='br-int',has_traffic_filtering=True,id=3de4734a-85d3-455d-a53d-a30e9bea20c2,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4734a-85') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'pci_devices' on Instance uuid 468562be-d411-4da2-bf90-7cb2b1edacca {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:35:48 user nova-compute[75026]:   <uuid>468562be-d411-4da2-bf90-7cb2b1edacca</uuid>
Nov 10 19:35:48 user nova-compute[75026]:   <name>instance-00000022</name>
Nov 10 19:35:48 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:35:48 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:35:48 user nova-compute[75026]:   <metadata>
Nov 10 19:35:48 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:35:48 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:35:48 user nova-compute[75026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-752617559</nova:name>
Nov 10 19:35:48 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:35:48</nova:creationTime>
Nov 10 19:35:48 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:35:48 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:35:48 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:35:48 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:35:48 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:35:48 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:35:48 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:35:48 user nova-compute[75026]:       <nova:owner>
Nov 10 19:35:48 user nova-compute[75026]:         <nova:user uuid="fcbd2be26ec84b5d9f6f6638963e870e">tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member</nova:user>
Nov 10 19:35:48 user nova-compute[75026]:         <nova:project uuid="43e468483e8f4f70bd228ff8194d76b7">tempest-ServerBootFromVolumeStableRescueTest-1118157225</nova:project>
Nov 10 19:35:48 user nova-compute[75026]:       </nova:owner>
Nov 10 19:35:48 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:35:48 user nova-compute[75026]:       <nova:ports>
Nov 10 19:35:48 user nova-compute[75026]:         <nova:port uuid="3de4734a-85d3-455d-a53d-a30e9bea20c2">
Nov 10 19:35:48 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:35:48 user nova-compute[75026]:         </nova:port>
Nov 10 19:35:48 user nova-compute[75026]:       </nova:ports>
Nov 10 19:35:48 user nova-compute[75026]:     </nova:instance>
Nov 10 19:35:48 user nova-compute[75026]:   </metadata>
Nov 10 19:35:48 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:35:48 user nova-compute[75026]:     <system>
Nov 10 19:35:48 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:35:48 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:35:48 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:35:48 user nova-compute[75026]:       <entry name="serial">468562be-d411-4da2-bf90-7cb2b1edacca</entry>
Nov 10 19:35:48 user nova-compute[75026]:       <entry name="uuid">468562be-d411-4da2-bf90-7cb2b1edacca</entry>
Nov 10 19:35:48 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:35:48 user nova-compute[75026]:     </system>
Nov 10 19:35:48 user nova-compute[75026]:   </sysinfo>
Nov 10 19:35:48 user nova-compute[75026]:   <os>
Nov 10 19:35:48 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:35:48 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:35:48 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:35:48 user nova-compute[75026]:   </os>
Nov 10 19:35:48 user nova-compute[75026]:   <features>
Nov 10 19:35:48 user nova-compute[75026]:     <acpi/>
Nov 10 19:35:48 user nova-compute[75026]:     <apic/>
Nov 10 19:35:48 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:35:48 user nova-compute[75026]:   </features>
Nov 10 19:35:48 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:35:48 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:35:48 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:35:48 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:35:48 user nova-compute[75026]:   </clock>
Nov 10 19:35:48 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:35:48 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:35:48 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:35:48 user nova-compute[75026]:   </cpu>
Nov 10 19:35:48 user nova-compute[75026]:   <devices>
Nov 10 19:35:48 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:35:48 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:35:48 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk"/>
Nov 10 19:35:48 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:35:48 user nova-compute[75026]:     </disk>
Nov 10 19:35:48 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:35:48 user nova-compute[75026]:       <mac address="fa:16:3e:11:28:35"/>
Nov 10 19:35:48 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:35:48 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:35:48 user nova-compute[75026]:       <target dev="tap3de4734a-85"/>
Nov 10 19:35:48 user nova-compute[75026]:     </interface>
Nov 10 19:35:48 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:35:48 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/console.log" append="off"/>
Nov 10 19:35:48 user nova-compute[75026]:     </serial>
Nov 10 19:35:48 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:35:48 user nova-compute[75026]:     <video>
Nov 10 19:35:48 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:35:48 user nova-compute[75026]:     </video>
Nov 10 19:35:48 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:35:48 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:35:48 user nova-compute[75026]:     </rng>
Nov 10 19:35:48 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:35:48 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:35:48 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:35:48 user nova-compute[75026]:     </memballoon>
Nov 10 19:35:48 user nova-compute[75026]:   </devices>
Nov 10 19:35:48 user nova-compute[75026]: </domain>
Nov 10 19:35:48 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-752617559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-752617559',id=34,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-06msk51f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:35:47Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=468562be-d411-4da2-bf90-7cb2b1edacca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:28:35,bridge_name='br-int',has_traffic_filtering=True,id=3de4734a-85d3-455d-a53d-a30e9bea20c2,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4734a-85') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG os_vif [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:28:35,bridge_name='br-int',has_traffic_filtering=True,id=3de4734a-85d3-455d-a53d-a30e9bea20c2,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4734a-85') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0cd87c54-7495-58d0-961d-7664316a0355', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de4734a-85, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3de4734a-85, col_values=(('qos', UUID('2bb0aee7-cf18-4465-a7bf-3dde0dfc4ea2')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3de4734a-85, col_values=(('external_ids', {'iface-id': '3de4734a-85d3-455d-a53d-a30e9bea20c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:28:35', 'vm-uuid': '468562be-d411-4da2-bf90-7cb2b1edacca'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:35:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:48 user nova-compute[75026]: INFO os_vif [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:28:35,bridge_name='br-int',has_traffic_filtering=True,id=3de4734a-85d3-455d-a53d-a30e9bea20c2,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4734a-85')
Nov 10 19:35:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:35:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No VIF found with MAC fa:16:3e:11:28:35, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:35:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-e075f2fa-d6ce-46e8-bcc9-6c068b8e5d98 req-f990e4b5-19b0-4ca0-8ced-a3acee2d1dcb service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Updated VIF entry in instance network info cache for port 3de4734a-85d3-455d-a53d-a30e9bea20c2. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:35:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-e075f2fa-d6ce-46e8-bcc9-6c068b8e5d98 req-f990e4b5-19b0-4ca0-8ced-a3acee2d1dcb service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Updating instance_info_cache with network_info: [{"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:35:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e075f2fa-d6ce-46e8-bcc9-6c068b8e5d98 req-f990e4b5-19b0-4ca0-8ced-a3acee2d1dcb service nova] Releasing lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-3b1d688b-62a1-4158-b387-bd9a2077f6af req-23f9254f-4c8e-435f-bfbf-5e63ae99b6cf service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3b1d688b-62a1-4158-b387-bd9a2077f6af req-23f9254f-4c8e-435f-bfbf-5e63ae99b6cf service nova] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3b1d688b-62a1-4158-b387-bd9a2077f6af req-23f9254f-4c8e-435f-bfbf-5e63ae99b6cf service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3b1d688b-62a1-4158-b387-bd9a2077f6af req-23f9254f-4c8e-435f-bfbf-5e63ae99b6cf service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-3b1d688b-62a1-4158-b387-bd9a2077f6af req-23f9254f-4c8e-435f-bfbf-5e63ae99b6cf service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] No waiting events found dispatching network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:35:50 user nova-compute[75026]: WARNING nova.compute.manager [req-3b1d688b-62a1-4158-b387-bd9a2077f6af req-23f9254f-4c8e-435f-bfbf-5e63ae99b6cf service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received unexpected event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 for instance with vm_state building and task_state spawning.
Nov 10 19:35:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:35:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Instance spawned successfully.
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-90dadf1f-607a-4bae-ad38-74c408340c9c req-41652729-d8ef-4981-9815-27928ba64dbd service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-90dadf1f-607a-4bae-ad38-74c408340c9c req-41652729-d8ef-4981-9815-27928ba64dbd service nova] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-90dadf1f-607a-4bae-ad38-74c408340c9c req-41652729-d8ef-4981-9815-27928ba64dbd service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-90dadf1f-607a-4bae-ad38-74c408340c9c req-41652729-d8ef-4981-9815-27928ba64dbd service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-90dadf1f-607a-4bae-ad38-74c408340c9c req-41652729-d8ef-4981-9815-27928ba64dbd service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] No waiting events found dispatching network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:35:52 user nova-compute[75026]: WARNING nova.compute.manager [req-90dadf1f-607a-4bae-ad38-74c408340c9c req-41652729-d8ef-4981-9815-27928ba64dbd service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received unexpected event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 for instance with vm_state building and task_state spawning.
Nov 10 19:35:52 user nova-compute[75026]: INFO nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 10 19:35:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:35:52 user nova-compute[75026]: INFO nova.compute.manager [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Took 5.90 seconds to build instance.
Nov 10 19:35:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c1d7ff85-eb5d-49fc-bd8d-f05966235bc4 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "468562be-d411-4da2-bf90-7cb2b1edacca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.996s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:35:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:35:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:36:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:36:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-608e7518-83e4-49ab-8b39-c08178675369 req-f10965d6-d311-4846-81f0-a249ba2f6829 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received event network-changed-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:36:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-608e7518-83e4-49ab-8b39-c08178675369 req-f10965d6-d311-4846-81f0-a249ba2f6829 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Refreshing instance network info cache due to event network-changed-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:36:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-608e7518-83e4-49ab-8b39-c08178675369 req-f10965d6-d311-4846-81f0-a249ba2f6829 service nova] Acquiring lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:36:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-608e7518-83e4-49ab-8b39-c08178675369 req-f10965d6-d311-4846-81f0-a249ba2f6829 service nova] Acquired lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:36:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-608e7518-83e4-49ab-8b39-c08178675369 req-f10965d6-d311-4846-81f0-a249ba2f6829 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Refreshing network info cache for port 18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:36:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-608e7518-83e4-49ab-8b39-c08178675369 req-f10965d6-d311-4846-81f0-a249ba2f6829 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Updated VIF entry in instance network info cache for port 18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:36:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-608e7518-83e4-49ab-8b39-c08178675369 req-f10965d6-d311-4846-81f0-a249ba2f6829 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Updating instance_info_cache with network_info: [{"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:36:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-608e7518-83e4-49ab-8b39-c08178675369 req-f10965d6-d311-4846-81f0-a249ba2f6829 service nova] Releasing lock "refresh_cache-4aa0a40a-b7ed-43b9-84c4-130af672d1b1" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:36:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:18 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-20c3fe9c-276e-4d83-bb85-0fef4d8070ec req-b12ff9bf-213d-41ff-bf0e-66a5eddf3496 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received event network-changed-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-20c3fe9c-276e-4d83-bb85-0fef4d8070ec req-b12ff9bf-213d-41ff-bf0e-66a5eddf3496 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Refreshing instance network info cache due to event network-changed-2deedd57-160c-4589-8e9a-bdcc4005b408. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20c3fe9c-276e-4d83-bb85-0fef4d8070ec req-b12ff9bf-213d-41ff-bf0e-66a5eddf3496 service nova] Acquiring lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20c3fe9c-276e-4d83-bb85-0fef4d8070ec req-b12ff9bf-213d-41ff-bf0e-66a5eddf3496 service nova] Acquired lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-20c3fe9c-276e-4d83-bb85-0fef4d8070ec req-b12ff9bf-213d-41ff-bf0e-66a5eddf3496 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Refreshing network info cache for port 2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-20c3fe9c-276e-4d83-bb85-0fef4d8070ec req-b12ff9bf-213d-41ff-bf0e-66a5eddf3496 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Updated VIF entry in instance network info cache for port 2deedd57-160c-4589-8e9a-bdcc4005b408. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-20c3fe9c-276e-4d83-bb85-0fef4d8070ec req-b12ff9bf-213d-41ff-bf0e-66a5eddf3496 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Updating instance_info_cache with network_info: [{"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-20c3fe9c-276e-4d83-bb85-0fef4d8070ec req-b12ff9bf-213d-41ff-bf0e-66a5eddf3496 service nova] Releasing lock "refresh_cache-8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:19 user nova-compute[75026]: INFO nova.compute.manager [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Terminating instance
Nov 10 19:36:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-aafc19d5-a98e-44a7-b823-30f72504da1c req-cae342a4-da94-47f0-96bc-b0902e56c699 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received event network-vif-unplugged-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aafc19d5-a98e-44a7-b823-30f72504da1c req-cae342a4-da94-47f0-96bc-b0902e56c699 service nova] Acquiring lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aafc19d5-a98e-44a7-b823-30f72504da1c req-cae342a4-da94-47f0-96bc-b0902e56c699 service nova] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aafc19d5-a98e-44a7-b823-30f72504da1c req-cae342a4-da94-47f0-96bc-b0902e56c699 service nova] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-aafc19d5-a98e-44a7-b823-30f72504da1c req-cae342a4-da94-47f0-96bc-b0902e56c699 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] No waiting events found dispatching network-vif-unplugged-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-aafc19d5-a98e-44a7-b823-30f72504da1c req-cae342a4-da94-47f0-96bc-b0902e56c699 service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received event network-vif-unplugged-2deedd57-160c-4589-8e9a-bdcc4005b408 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'flavor' on Instance uuid 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:20 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Instance destroyed successfully.
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'resources' on Instance uuid 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1397075974',display_name='tempest-TestVolumeBootPattern-server-1397075974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1397075974',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-0817f8y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:35:09Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=8dfd6aaa-ef1b-4acb-a473-f17c59991f3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "2deedd57-160c-4589-8e9a-bdcc4005b408", "address": "fa:16:3e:56:e4:fe", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2deedd57-16", "ovs_interfaceid": "2deedd57-160c-4589-8e9a-bdcc4005b408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=2deedd57-160c-4589-8e9a-bdcc4005b408,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2deedd57-16') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_vif [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=2deedd57-160c-4589-8e9a-bdcc4005b408,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2deedd57-16') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2deedd57-16, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b4d28ce-7831-477e-aa31-192a97c581c6) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:36:20 user nova-compute[75026]: INFO os_vif [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=2deedd57-160c-4589-8e9a-bdcc4005b408,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2deedd57-16')
Nov 10 19:36:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUWqNMgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:36:20 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab3b4b4-d310-4991-b436-1aa7a5aca1a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:36:20 user nova-compute[75026]: No targets found.
Nov 10 19:36:20 user nova-compute[75026]: iSNS:
Nov 10 19:36:20 user nova-compute[75026]: No targets found.
Nov 10 19:36:20 user nova-compute[75026]: STATIC:
Nov 10 19:36:20 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0
Nov 10 19:36:20 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:36:20 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:36:20 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8
Nov 10 19:36:20 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:36:20 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:36:20 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:36:20 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:36:20 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:36:20 user nova-compute[75026]: FIRMWARE:
Nov 10 19:36:20 user nova-compute[75026]: No targets found.
Nov 10 19:36:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:36:20 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:36:20 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[81667fab-4b1d-4591-b6a3-c589f3a40c52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f9b09-0f25-41d1-9f87-59fe2b8e9b09]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:36:20 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:36:20 user nova-compute[75026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:36:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:36:20 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:36:20 user nova-compute[75026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:36:20 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed983381f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:20 user nova-compute[75026]: INFO nova.compute.manager [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Attaching volume c3da68ee-a5f3-47a8-b4bd-a19c369275bb to /dev/vdb
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7e09ce-b314-4bc1-b5f7-9c822b075af7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ac52c8-f108-47a0-a7a8-46d77b08e3dc]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.utils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4dac3b-590b-4d2b-b923-2d173b3a98ad]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac54d4c-faad-40ad-ba19-3cde89bead37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[191dfb1c-c101-4071-b6d4-0ce2991b8b04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4754d3b1-62ac-4161-b77c-81c70dbb9191]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36737b7-e345-48ed-b06c-2aac22dbba65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_50d18739', '/dev/disk/by-id/scsi-1SCST_BIO50d18739-9d8d3225ff0dd174', '/dev/disk/by-id/scsi-23964386433323235') {{(pid=86097) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 19:36:21 user nova-compute[75026]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO50d18739-9d8d3225ff0dd174
Nov 10 19:36:21 user nova-compute[75026]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23964386433323235
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[999f2f47-27b7-4e71-9020-583fb1a16c28]: (4, None) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e42d1fc-409d-4c3a-af46-5727c514822f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ec8992-9027-4fc6-87e7-2e924332d32a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:36:21 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e00b43-2cc0-494b-b04b-32d818cffad3]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.utils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Updating existing volume attachment record: 609b5682-6f31-4098-a783-107c93439e2a {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3523f7a8-013f-4583-bddd-8383e14a1ed0]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260]
Nov 10 19:36:21 user nova-compute[75026]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260] successful.
Nov 10 19:36:21 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[601859f1-a624-416a-b83e-7331c0fa6e3e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== disconnect_volume: return (388ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:36:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Deleting instance files /opt/stack/data/nova/instances/8dfd6aaa-ef1b-4acb-a473-f17c59991f3f_del
Nov 10 19:36:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Deletion of /opt/stack/data/nova/instances/8dfd6aaa-ef1b-4acb-a473-f17c59991f3f_del complete
Nov 10 19:36:21 user nova-compute[75026]: INFO nova.compute.manager [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Skipping network cache update for instance because it is being deleted. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:36:21 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid b9e39b1a-3119-456e-b16d-192dbcd66ae3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:36:22 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Took 0.97 seconds to deallocate network for instance.
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-1190c853-2d4c-4eac-801f-01b7429ba545 req-2e8e3392-7567-4bb3-9d1f-f08c062c87ec service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received event network-vif-deleted-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:36:22 user nova-compute[75026]: INFO nova.compute.manager [req-1190c853-2d4c-4eac-801f-01b7429ba545 req-2e8e3392-7567-4bb3-9d1f-f08c062c87ec service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Neutron deleted interface 2deedd57-160c-4589-8e9a-bdcc4005b408; detaching it from the instance and deleting it from the info cache
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.network.neutron [req-1190c853-2d4c-4eac-801f-01b7429ba545 req-2e8e3392-7567-4bb3-9d1f-f08c062c87ec service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-1190c853-2d4c-4eac-801f-01b7429ba545 req-2e8e3392-7567-4bb3-9d1f-f08c062c87ec service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Detach interface failed, port_id=2deedd57-160c-4589-8e9a-bdcc4005b408, reason: Instance 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-16a08a9e-e810-4bc1-882d-8f5a4daba493 req-d53632d7-012d-409e-ab03-36e948d8294c service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received event network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16a08a9e-e810-4bc1-882d-8f5a4daba493 req-d53632d7-012d-409e-ab03-36e948d8294c service nova] Acquiring lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16a08a9e-e810-4bc1-882d-8f5a4daba493 req-d53632d7-012d-409e-ab03-36e948d8294c service nova] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16a08a9e-e810-4bc1-882d-8f5a4daba493 req-d53632d7-012d-409e-ab03-36e948d8294c service nova] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-16a08a9e-e810-4bc1-882d-8f5a4daba493 req-d53632d7-012d-409e-ab03-36e948d8294c service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] No waiting events found dispatching network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:36:22 user nova-compute[75026]: WARNING nova.compute.manager [req-16a08a9e-e810-4bc1-882d-8f5a4daba493 req-d53632d7-012d-409e-ab03-36e948d8294c service nova] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Received unexpected event network-vif-plugged-2deedd57-160c-4589-8e9a-bdcc4005b408 for instance with vm_state active and task_state deleting.
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updating instance_info_cache with network_info: [{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:25 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:36:25 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7966MB free_disk=25.34356689453125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2cb39412-b6de-4fa7-b720-8c20ac7c25fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:36:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:36:28 user nova-compute[75026]: INFO nova.compute.manager [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f] Took 5.94 seconds to detach 1 volumes for instance.
Nov 10 19:36:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:28 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:36:28 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:36:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:28 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Deleted allocations for instance 8dfd6aaa-ef1b-4acb-a473-f17c59991f3f
Nov 10 19:36:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2833a05a-d500-46b7-8b9a-7a32e7b4bcee tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8dfd6aaa-ef1b-4acb-a473-f17c59991f3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.703s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:32 user nova-compute[75026]: INFO nova.compute.manager [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Terminating instance
Nov 10 19:36:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-b42042a5-8249-43dc-91c4-abf4e8450b2e req-b6657679-32f9-4147-b3fd-5555f58576d6 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received event network-vif-unplugged-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b42042a5-8249-43dc-91c4-abf4e8450b2e req-b6657679-32f9-4147-b3fd-5555f58576d6 service nova] Acquiring lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b42042a5-8249-43dc-91c4-abf4e8450b2e req-b6657679-32f9-4147-b3fd-5555f58576d6 service nova] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b42042a5-8249-43dc-91c4-abf4e8450b2e req-b6657679-32f9-4147-b3fd-5555f58576d6 service nova] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-b42042a5-8249-43dc-91c4-abf4e8450b2e req-b6657679-32f9-4147-b3fd-5555f58576d6 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] No waiting events found dispatching network-vif-unplugged-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-b42042a5-8249-43dc-91c4-abf4e8450b2e req-b6657679-32f9-4147-b3fd-5555f58576d6 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received event network-vif-unplugged-034f80c3-8578-4405-898a-8b4c1d9412e2 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:36:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Instance destroyed successfully.
Nov 10 19:36:33 user nova-compute[75026]: DEBUG nova.objects.instance [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lazy-loading 'resources' on Instance uuid 2cb39412-b6de-4fa7-b720-8c20ac7c25fc {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1507033356',display_name='tempest-VolumesActionsTest-instance-1507033356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1507033356',id=33,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:34:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4399f5415c44727be21445bbee1bc1b',ramdisk_id='',reservation_id='r-og7v0dvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1070572732',owner_user_name='tempest-VolumesActionsTest-1070572732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:34:49Z,user_data=None,user_id='fe3a0de9e0cb4826967417d8f29fe839',uuid=2cb39412-b6de-4fa7-b720-8c20ac7c25fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converting VIF {"id": "034f80c3-8578-4405-898a-8b4c1d9412e2", "address": "fa:16:3e:5b:b9:ea", "network": {"id": "89bc8cfe-91e2-476e-8f93-aeb456160831", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1629109003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4399f5415c44727be21445bbee1bc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap034f80c3-85", "ovs_interfaceid": "034f80c3-8578-4405-898a-8b4c1d9412e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=034f80c3-8578-4405-898a-8b4c1d9412e2,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034f80c3-85') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG os_vif [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=034f80c3-8578-4405-898a-8b4c1d9412e2,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034f80c3-85') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap034f80c3-85, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a10d878-f47b-45b9-b4d3-810f4b7af455) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:36:33 user nova-compute[75026]: INFO os_vif [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:ea,bridge_name='br-int',has_traffic_filtering=True,id=034f80c3-8578-4405-898a-8b4c1d9412e2,network=Network(89bc8cfe-91e2-476e-8f93-aeb456160831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap034f80c3-85')
Nov 10 19:36:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Deleting instance files /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc_del
Nov 10 19:36:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Deletion of /opt/stack/data/nova/instances/2cb39412-b6de-4fa7-b720-8c20ac7c25fc_del complete
Nov 10 19:36:33 user nova-compute[75026]: INFO nova.compute.manager [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 10 19:36:33 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:36:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-d87b8d7a-e7c7-4ed6-878f-50590cbdad03 req-fdafcb65-536c-4b8c-aaf3-80e7da1d9001 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received event network-vif-deleted-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:36:34 user nova-compute[75026]: INFO nova.compute.manager [req-d87b8d7a-e7c7-4ed6-878f-50590cbdad03 req-fdafcb65-536c-4b8c-aaf3-80e7da1d9001 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Neutron deleted interface 034f80c3-8578-4405-898a-8b4c1d9412e2; detaching it from the instance and deleting it from the info cache
Nov 10 19:36:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-d87b8d7a-e7c7-4ed6-878f-50590cbdad03 req-fdafcb65-536c-4b8c-aaf3-80e7da1d9001 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:36:34 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Took 0.54 seconds to deallocate network for instance.
Nov 10 19:36:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-d87b8d7a-e7c7-4ed6-878f-50590cbdad03 req-fdafcb65-536c-4b8c-aaf3-80e7da1d9001 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Detach interface failed, port_id=034f80c3-8578-4405-898a-8b4c1d9412e2, reason: Instance 2cb39412-b6de-4fa7-b720-8c20ac7c25fc could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:34 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Deleted allocations for instance 2cb39412-b6de-4fa7-b720-8c20ac7c25fc
Nov 10 19:36:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-8a3ab6ba-e355-4de1-9088-d6913f91c69e tempest-VolumesActionsTest-1070572732 tempest-VolumesActionsTest-1070572732-project-member] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-d7440304-342f-4114-9a05-78f256693c56 req-7b9d6f09-df8e-4393-bf2e-4d1cec6f7ed5 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received event network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7440304-342f-4114-9a05-78f256693c56 req-7b9d6f09-df8e-4393-bf2e-4d1cec6f7ed5 service nova] Acquiring lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7440304-342f-4114-9a05-78f256693c56 req-7b9d6f09-df8e-4393-bf2e-4d1cec6f7ed5 service nova] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7440304-342f-4114-9a05-78f256693c56 req-7b9d6f09-df8e-4393-bf2e-4d1cec6f7ed5 service nova] Lock "2cb39412-b6de-4fa7-b720-8c20ac7c25fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-d7440304-342f-4114-9a05-78f256693c56 req-7b9d6f09-df8e-4393-bf2e-4d1cec6f7ed5 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] No waiting events found dispatching network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:36:34 user nova-compute[75026]: WARNING nova.compute.manager [req-d7440304-342f-4114-9a05-78f256693c56 req-7b9d6f09-df8e-4393-bf2e-4d1cec6f7ed5 service nova] [instance: 2cb39412-b6de-4fa7-b720-8c20ac7c25fc] Received unexpected event network-vif-plugged-034f80c3-8578-4405-898a-8b4c1d9412e2 for instance with vm_state deleted and task_state None.
Nov 10 19:36:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWHXexcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:36:45 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:36:45 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:36:45 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d0c28a-009b-4960-8374-d199cdef0f41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:36:45 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acc7bf5-e739-4293-b374-8b58cefda25b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb] added
Nov 10 19:36:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[590eb437-d42f-41b0-8a66-4241cf74b18f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0303c3ee-fdba-40e8-b98a-19ffc49bf24c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EWHXexcm {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EWHXexcm" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd2995-18f6-4964-9224-9e68c6e81e87]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EWHXexcm'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[03101010-41a1-4de4-a16d-fa73805f721c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d638079e-4bb9-4eec-a400-e0993a81a9b3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:36:45 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:36:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:36:45 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:36:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc52ba7-4d7e-4b34-9c45-923772e71491]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb, portal: 172.16.0.220,3260]
Nov 10 19:36:45 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb, portal: 172.16.0.220,3260] successful.
Nov 10 19:36:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[95163182-9b1c-41b8-afc6-927b54efa17e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f550c093-8246-44a8-a32e-78a31c2ec2ac]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:36:45 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:36:45 user nova-compute[75026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb (non-flash)
Nov 10 19:36:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:36:45 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:36:45 user nova-compute[75026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb (non-flash)
Nov 10 19:36:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb583fa-235f-4972-ae12-f2f8f7107b87]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:36:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWHXexcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:36:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:36:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23030393337666564', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:36:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030393337666564', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:36:46 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'flavor' on Instance uuid 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:36:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:36:46 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:36:46 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:36:46 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:36:46 user nova-compute[75026]:   <serial>c3da68ee-a5f3-47a8-b4bd-a19c369275bb</serial>
Nov 10 19:36:46 user nova-compute[75026]: </disk>
Nov 10 19:36:46 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:36:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:36:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:36:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] No VIF found with MAC fa:16:3e:10:d7:e2, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:36:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d3db6ceb-5859-4c15-8117-592e9f1d4dcd tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.691s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:36:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:36:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:36:48 user nova-compute[75026]: INFO nova.compute.manager [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Detaching volume c3da68ee-a5f3-47a8-b4bd-a19c369275bb
Nov 10 19:36:48 user nova-compute[75026]: INFO nova.virt.block_device [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Attempting to driver detach volume c3da68ee-a5f3-47a8-b4bd-a19c369275bb from mountpoint /dev/vdb
Nov 10 19:36:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Attempting to detach device vdb from instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:36:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:36:48 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:36:48 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:36:48 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:36:48 user nova-compute[75026]:   <serial>c3da68ee-a5f3-47a8-b4bd-a19c369275bb</serial>
Nov 10 19:36:48 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:36:48 user nova-compute[75026]: </disk>
Nov 10 19:36:48 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:36:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully detached device vdb from instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 from the persistent domain config.
Nov 10 19:36:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:36:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:36:48 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:36:48 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:36:48 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:36:48 user nova-compute[75026]:   <serial>c3da68ee-a5f3-47a8-b4bd-a19c369275bb</serial>
Nov 10 19:36:48 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:36:48 user nova-compute[75026]: </disk>
Nov 10 19:36:48 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:36:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:36:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:36:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 is timed out.
Nov 10 19:37:08 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully detached device vdb from instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 from the live domain config.
Nov 10 19:37:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWHXexcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:37:08 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c0c071-1d8c-42c8-86d4-6486fc38137a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:37:08 user nova-compute[75026]: No targets found.
Nov 10 19:37:08 user nova-compute[75026]: iSNS:
Nov 10 19:37:08 user nova-compute[75026]: No targets found.
Nov 10 19:37:08 user nova-compute[75026]: STATIC:
Nov 10 19:37:08 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb
Nov 10 19:37:08 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:37:08 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:37:08 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8
Nov 10 19:37:08 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:37:08 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:37:08 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:37:08 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:37:08 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:37:08 user nova-compute[75026]: FIRMWARE:
Nov 10 19:37:08 user nova-compute[75026]: No targets found.
Nov 10 19:37:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:37:08 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:37:08 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a63517-b5c8-4b11-a4f6-4cc81c06e6d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e49710-8b87-46fd-96bb-b3c3a3da8784]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:37:08 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:37:08 user nova-compute[75026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb (non-flash)
Nov 10 19:37:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:37:08 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:37:08 user nova-compute[75026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb (non-flash)
Nov 10 19:37:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed80356560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5b61fb-2a90-454d-b3bc-4518e3054089]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e2609c-3b46-41b6-b7d8-00f844d31177]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56cf8a9-c5da-4965-a9ed-02fc10699908]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c8da97-0149-48e6-bca0-90b20ee7fc0b]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea5f935-b6d4-4b85-b2a5-4c2f792ae00a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[72790a53-c9ed-4bfd-ac0a-51afdd6dae9d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb, portal: 172.16.0.220,3260]
Nov 10 19:37:09 user nova-compute[75026]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb, portal: 172.16.0.220,3260] successful.
Nov 10 19:37:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da68ee-a5f3-47a8-b4bd-a19c369275bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[69174bcd-ef2e-43a2-8d94-e8533fa60e13]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] <== disconnect_volume: return (322ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:37:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'flavor' on Instance uuid 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:37:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d2b16250-529a-4232-a7cb-e605bbdf130a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.914s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:37:11 user nova-compute[75026]: INFO nova.compute.claims [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Claim successful on node user
Nov 10 19:37:11 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:11 user nova-compute[75026]: DEBUG nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG nova.network.neutron [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:37:12 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:37:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG nova.policy [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '758478b59f94467898696fa7af7cd630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e509e662d27146fba4f51fd55dbe6f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:37:12 user nova-compute[75026]: INFO nova.virt.block_device [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Booting with volume 3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 at /dev/vda
Nov 10 19:37:12 user nova-compute[75026]: DEBUG os_brick.utils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d26663c-bc23-4a32-86ac-bf46a29f6911]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0336d4fb-00b8-4bf0-9826-8df6108848bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb49cac6-37d0-41d6-b776-57920707df24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ad693b-886b-4501-9307-4cf6b65a569a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:37:12 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:37:12 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[952073e9-5102-4dfb-bfa2-b0588f072c42]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG os_brick.utils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updating existing volume attachment record: 7ab926cb-79a5-4449-bb46-059e6e3f8053 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:37:12 user nova-compute[75026]: DEBUG nova.network.neutron [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Successfully created port: 59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Successfully updated port: 59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquired lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-8a9ca8d1-aa6f-45ae-902c-9c94df89c332 req-5e678bb5-1026-4fdc-9b9b-fd5ae5340872 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-changed-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-8a9ca8d1-aa6f-45ae-902c-9c94df89c332 req-5e678bb5-1026-4fdc-9b9b-fd5ae5340872 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Refreshing instance network info cache due to event network-changed-59405ecb-8bc7-45a9-b819-880c218ed01c. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a9ca8d1-aa6f-45ae-902c-9c94df89c332 req-5e678bb5-1026-4fdc-9b9b-fd5ae5340872 service nova] Acquiring lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:37:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:37:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updating instance_info_cache with network_info: [{"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:37:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Releasing lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:37:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Instance network_info: |[{"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:37:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a9ca8d1-aa6f-45ae-902c-9c94df89c332 req-5e678bb5-1026-4fdc-9b9b-fd5ae5340872 service nova] Acquired lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:37:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-8a9ca8d1-aa6f-45ae-902c-9c94df89c332 req-5e678bb5-1026-4fdc-9b9b-fd5ae5340872 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Refreshing network info cache for port 59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:37:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-8a9ca8d1-aa6f-45ae-902c-9c94df89c332 req-5e678bb5-1026-4fdc-9b9b-fd5ae5340872 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updated VIF entry in instance network info cache for port 59405ecb-8bc7-45a9-b819-880c218ed01c. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:37:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-8a9ca8d1-aa6f-45ae-902c-9c94df89c332 req-5e678bb5-1026-4fdc-9b9b-fd5ae5340872 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updating instance_info_cache with network_info: [{"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:37:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8a9ca8d1-aa6f-45ae-902c-9c94df89c332 req-5e678bb5-1026-4fdc-9b9b-fd5ae5340872 service nova] Releasing lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:37:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:20 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:21 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:37:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:24 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:37:24 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8213MB free_disk=25.368488311767578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:37:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:37:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:37:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:37:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:37:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:37:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:37:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:37:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:37:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:27 user nova-compute[75026]: INFO nova.compute.manager [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Detaching volume 8edc5d51-750e-410a-b239-d87b34d2c6a8
Nov 10 19:37:27 user nova-compute[75026]: INFO nova.virt.block_device [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Attempting to driver detach volume 8edc5d51-750e-410a-b239-d87b34d2c6a8 from mountpoint /dev/vdb
Nov 10 19:37:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Attempting to detach device vdb from instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:37:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:37:27 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:37:27 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:37:27 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:37:27 user nova-compute[75026]:   <serial>8edc5d51-750e-410a-b239-d87b34d2c6a8</serial>
Nov 10 19:37:27 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 19:37:27 user nova-compute[75026]: </disk>
Nov 10 19:37:27 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:37:27 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully detached device vdb from instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 from the persistent domain config.
Nov 10 19:37:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:37:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:37:27 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:37:27 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:37:27 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:37:27 user nova-compute[75026]:   <serial>8edc5d51-750e-410a-b239-d87b34d2c6a8</serial>
Nov 10 19:37:27 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 19:37:27 user nova-compute[75026]: </disk>
Nov 10 19:37:27 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:37:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:37:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:37:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:37:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:37:37 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Creating image(s)
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Ensure instance console log exists: /opt/stack/data/nova/instances/0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Start _get_guest_xml network_info=[{"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '7ab926cb-79a5-4449-bb46-059e6e3f8053', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUWqNMgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a', 'attached_at': '', 'detached_at': '', 'volume_id': '3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'serial': '3aa29c9f-2950-435a-bbe9-293b5a1f6bc0'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:37:37 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:37:37 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUWqNMgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:37:37 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:37:37 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:37:37 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f594bbe7-4f56-4b9a-b410-29bcfd3dc75d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:37:37 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[893cc277-5e9e-4852-a7d2-7ea40b158468]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0] added
Nov 10 19:37:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a22638-0ebf-4fb5-9ac8-91bdf26b50f8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17ce831-9457-4af2-9c00-5f2b27dd7ac9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUWqNMgc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUWqNMgc" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ea054-60ae-4b04-8968-31d2335a39d9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUWqNMgc'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3356b3-38ec-4cc2-8b65-a853c4160198]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba9f02-970b-43f5-98c3-b2f1903b2fc5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[029fdb31-dd93-48be-967a-4da6b64c1ec9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260]
Nov 10 19:37:37 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260] successful.
Nov 10 19:37:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b40b4-20da-486f-a191-c25eb77ad66b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b85585e-b612-464b-b69c-ad8a11adfccf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:37:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[83443410-7e64-47e2-9970-e58ff7692dde]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUWqNMgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:37:37 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:37:37 user nova-compute[75026]: INFO nova.compute.manager [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] instance snapshotting
Nov 10 19:37:37 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Beginning live snapshot process
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json -f qcow2 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json -f qcow2 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:38 user nova-compute[75026]: INFO nova.compute.manager [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Terminating instance
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5n6fn6ei/cf117a4f10d74c10ad0353e718507f9a.delta 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5n6fn6ei/cf117a4f10d74c10ad0353e718507f9a.delta 1073741824" returned: 0 in 0.062s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:38 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 19:37:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23964386433323235', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964386433323235', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1695131438',display_name='tempest-TestVolumeBootPattern-server-1695131438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1695131438',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-v8pcof0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:37:12Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=59405ecb-8bc7-45a9-b819-880c218ed01c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59405ecb-8b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.objects.instance [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:37:38 user nova-compute[75026]:   <uuid>0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a</uuid>
Nov 10 19:37:38 user nova-compute[75026]:   <name>instance-00000023</name>
Nov 10 19:37:38 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:37:38 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:37:38 user nova-compute[75026]:   <metadata>
Nov 10 19:37:38 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:37:38 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:37:38 user nova-compute[75026]:       <nova:name>tempest-TestVolumeBootPattern-server-1695131438</nova:name>
Nov 10 19:37:38 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:37:37</nova:creationTime>
Nov 10 19:37:38 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:37:38 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:37:38 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:37:38 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:37:38 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:37:38 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:37:38 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:37:38 user nova-compute[75026]:       <nova:owner>
Nov 10 19:37:38 user nova-compute[75026]:         <nova:user uuid="758478b59f94467898696fa7af7cd630">tempest-TestVolumeBootPattern-1182723443-project-member</nova:user>
Nov 10 19:37:38 user nova-compute[75026]:         <nova:project uuid="e509e662d27146fba4f51fd55dbe6f83">tempest-TestVolumeBootPattern-1182723443</nova:project>
Nov 10 19:37:38 user nova-compute[75026]:       </nova:owner>
Nov 10 19:37:38 user nova-compute[75026]:       <nova:ports>
Nov 10 19:37:38 user nova-compute[75026]:         <nova:port uuid="59405ecb-8bc7-45a9-b819-880c218ed01c">
Nov 10 19:37:38 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 19:37:38 user nova-compute[75026]:         </nova:port>
Nov 10 19:37:38 user nova-compute[75026]:       </nova:ports>
Nov 10 19:37:38 user nova-compute[75026]:     </nova:instance>
Nov 10 19:37:38 user nova-compute[75026]:   </metadata>
Nov 10 19:37:38 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:37:38 user nova-compute[75026]:     <system>
Nov 10 19:37:38 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:37:38 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:37:38 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:37:38 user nova-compute[75026]:       <entry name="serial">0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a</entry>
Nov 10 19:37:38 user nova-compute[75026]:       <entry name="uuid">0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a</entry>
Nov 10 19:37:38 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:37:38 user nova-compute[75026]:     </system>
Nov 10 19:37:38 user nova-compute[75026]:   </sysinfo>
Nov 10 19:37:38 user nova-compute[75026]:   <os>
Nov 10 19:37:38 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:37:38 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:37:38 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:37:38 user nova-compute[75026]:   </os>
Nov 10 19:37:38 user nova-compute[75026]:   <features>
Nov 10 19:37:38 user nova-compute[75026]:     <acpi/>
Nov 10 19:37:38 user nova-compute[75026]:     <apic/>
Nov 10 19:37:38 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:37:38 user nova-compute[75026]:   </features>
Nov 10 19:37:38 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:37:38 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:37:38 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:37:38 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:37:38 user nova-compute[75026]:   </clock>
Nov 10 19:37:38 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:37:38 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:37:38 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:37:38 user nova-compute[75026]:   </cpu>
Nov 10 19:37:38 user nova-compute[75026]:   <devices>
Nov 10 19:37:38 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:37:38 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:37:38 user nova-compute[75026]:       <source dev="/dev/sdb"/>
Nov 10 19:37:38 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:37:38 user nova-compute[75026]:       <serial>3aa29c9f-2950-435a-bbe9-293b5a1f6bc0</serial>
Nov 10 19:37:38 user nova-compute[75026]:     </disk>
Nov 10 19:37:38 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:37:38 user nova-compute[75026]:       <mac address="fa:16:3e:15:0a:ad"/>
Nov 10 19:37:38 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:37:38 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:37:38 user nova-compute[75026]:       <target dev="tap59405ecb-8b"/>
Nov 10 19:37:38 user nova-compute[75026]:     </interface>
Nov 10 19:37:38 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:37:38 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a/console.log" append="off"/>
Nov 10 19:37:38 user nova-compute[75026]:     </serial>
Nov 10 19:37:38 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:37:38 user nova-compute[75026]:     <video>
Nov 10 19:37:38 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:37:38 user nova-compute[75026]:     </video>
Nov 10 19:37:38 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:37:38 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:37:38 user nova-compute[75026]:     </rng>
Nov 10 19:37:38 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:37:38 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:37:38 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:37:38 user nova-compute[75026]:     </memballoon>
Nov 10 19:37:38 user nova-compute[75026]:   </devices>
Nov 10 19:37:38 user nova-compute[75026]: </domain>
Nov 10 19:37:38 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1695131438',display_name='tempest-TestVolumeBootPattern-server-1695131438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1695131438',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-v8pcof0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:37:12Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=59405ecb-8bc7-45a9-b819-880c218ed01c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59405ecb-8b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG os_vif [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=59405ecb-8bc7-45a9-b819-880c218ed01c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59405ecb-8b') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83f1dd5b-adf5-5f3b-98e8-3b651486e777', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59405ecb-8b, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59405ecb-8b, col_values=(('qos', UUID('583dfbab-a5fd-4758-8b64-45748b5f11f7')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59405ecb-8b, col_values=(('external_ids', {'iface-id': '59405ecb-8bc7-45a9-b819-880c218ed01c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:0a:ad', 'vm-uuid': '0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:38 user nova-compute[75026]: INFO os_vif [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=59405ecb-8bc7-45a9-b819-880c218ed01c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59405ecb-8b')
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-31833b83-9e49-4328-8aad-ad0a400fb0b3 req-c55dde2a-a63d-4bc2-8b6a-b6f89442f7f4 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received event network-vif-unplugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-31833b83-9e49-4328-8aad-ad0a400fb0b3 req-c55dde2a-a63d-4bc2-8b6a-b6f89442f7f4 service nova] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-31833b83-9e49-4328-8aad-ad0a400fb0b3 req-c55dde2a-a63d-4bc2-8b6a-b6f89442f7f4 service nova] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-31833b83-9e49-4328-8aad-ad0a400fb0b3 req-c55dde2a-a63d-4bc2-8b6a-b6f89442f7f4 service nova] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-31833b83-9e49-4328-8aad-ad0a400fb0b3 req-c55dde2a-a63d-4bc2-8b6a-b6f89442f7f4 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] No waiting events found dispatching network-vif-unplugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-31833b83-9e49-4328-8aad-ad0a400fb0b3 req-c55dde2a-a63d-4bc2-8b6a-b6f89442f7f4 service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received event network-vif-unplugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:37:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No VIF found with MAC fa:16:3e:15:0a:ad, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:37:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:37:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:37:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 19:37:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Instance destroyed successfully.
Nov 10 19:37:40 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lazy-loading 'resources' on Instance uuid 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-324061038',display_name='tempest-AttachVolumeNegativeTest-server-324061038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-324061038',id=31,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGzGNidniTxPYQS3CwAyK236iVImeyN1gJxb0lxeYP24/r227FjCYyKUqPuWYDG2axZPRByu7GaHgTM8LHmA3q/zRj9SzrDKqfKjpJRVOhxLHmjRvNuuToi7btOK5ghsg==',key_name='tempest-keypair-1096075716',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:34:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a491b667d34c4a9f991e2d7d29099671',ramdisk_id='',reservation_id='r-vweoodbb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1780662801',owner_user_name='tempest-AttachVolumeNegativeTest-1780662801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a44857fb02f843df95883ee2b5daf3ce',uuid=4aa0a40a-b7ed-43b9-84c4-130af672d1b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converting VIF {"id": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "address": "fa:16:3e:10:d7:e2", "network": {"id": "d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2017722199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a491b667d34c4a9f991e2d7d29099671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fe908a-fc", "ovs_interfaceid": "18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:d7:e2,bridge_name='br-int',has_traffic_filtering=True,id=18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fe908a-fc') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG os_vif [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:d7:e2,bridge_name='br-int',has_traffic_filtering=True,id=18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fe908a-fc') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18fe908a-fc, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4e507c0-a006-4a1a-8615-42ebb65ad5c5) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:40 user nova-compute[75026]: INFO os_vif [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:d7:e2,bridge_name='br-int',has_traffic_filtering=True,id=18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d,network=Network(d3ddfe4a-2aaa-4c9a-920e-9c7c697491ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fe908a-fc')
Nov 10 19:37:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Deleting instance files /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1_del
Nov 10 19:37:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Deletion of /opt/stack/data/nova/instances/4aa0a40a-b7ed-43b9-84c4-130af672d1b1_del complete
Nov 10 19:37:40 user nova-compute[75026]: INFO nova.compute.manager [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Took 1.88 seconds to destroy the instance on the hypervisor.
Nov 10 19:37:40 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5n6fn6ei/cf117a4f10d74c10ad0353e718507f9a.delta /opt/stack/data/nova/instances/snapshots/tmp5n6fn6ei/cf117a4f10d74c10ad0353e718507f9a {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-49215e19-7bd4-43e0-b8f8-b75e4f3fc9b8 req-4d47e1be-cfae-4457-83b1-3af7f93a83aa service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received event network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-49215e19-7bd4-43e0-b8f8-b75e4f3fc9b8 req-4d47e1be-cfae-4457-83b1-3af7f93a83aa service nova] Acquiring lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-49215e19-7bd4-43e0-b8f8-b75e4f3fc9b8 req-4d47e1be-cfae-4457-83b1-3af7f93a83aa service nova] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-49215e19-7bd4-43e0-b8f8-b75e4f3fc9b8 req-4d47e1be-cfae-4457-83b1-3af7f93a83aa service nova] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-49215e19-7bd4-43e0-b8f8-b75e4f3fc9b8 req-4d47e1be-cfae-4457-83b1-3af7f93a83aa service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] No waiting events found dispatching network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:37:41 user nova-compute[75026]: WARNING nova.compute.manager [req-49215e19-7bd4-43e0-b8f8-b75e4f3fc9b8 req-4d47e1be-cfae-4457-83b1-3af7f93a83aa service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received unexpected event network-vif-plugged-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d for instance with vm_state active and task_state deleting.
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-852d40a6-eab8-4d18-9919-fc3c208e25a0 req-4b9bdad5-ed2b-4b3b-889a-5bb198015572 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-852d40a6-eab8-4d18-9919-fc3c208e25a0 req-4b9bdad5-ed2b-4b3b-889a-5bb198015572 service nova] Acquiring lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-852d40a6-eab8-4d18-9919-fc3c208e25a0 req-4b9bdad5-ed2b-4b3b-889a-5bb198015572 service nova] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.021s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-852d40a6-eab8-4d18-9919-fc3c208e25a0 req-4b9bdad5-ed2b-4b3b-889a-5bb198015572 service nova] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-852d40a6-eab8-4d18-9919-fc3c208e25a0 req-4b9bdad5-ed2b-4b3b-889a-5bb198015572 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] No waiting events found dispatching network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:37:41 user nova-compute[75026]: WARNING nova.compute.manager [req-852d40a6-eab8-4d18-9919-fc3c208e25a0 req-4b9bdad5-ed2b-4b3b-889a-5bb198015572 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received unexpected event network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c for instance with vm_state building and task_state spawning.
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-97d0ff81-265f-40ea-975c-4f28b5e7cc0e req-55338142-c6a1-44e3-9220-15d9d8aa825f service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Received event network-vif-deleted-18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:37:41 user nova-compute[75026]: INFO nova.compute.manager [req-97d0ff81-265f-40ea-975c-4f28b5e7cc0e req-55338142-c6a1-44e3-9220-15d9d8aa825f service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Neutron deleted interface 18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d; detaching it from the instance and deleting it from the info cache
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.network.neutron [req-97d0ff81-265f-40ea-975c-4f28b5e7cc0e req-55338142-c6a1-44e3-9220-15d9d8aa825f service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5n6fn6ei/cf117a4f10d74c10ad0353e718507f9a.delta /opt/stack/data/nova/instances/snapshots/tmp5n6fn6ei/cf117a4f10d74c10ad0353e718507f9a" returned: 0 in 0.678s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:41 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Snapshot extracted, beginning image upload
Nov 10 19:37:41 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Took 0.94 seconds to deallocate network for instance.
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-97d0ff81-265f-40ea-975c-4f28b5e7cc0e req-55338142-c6a1-44e3-9220-15d9d8aa825f service nova] [instance: 4aa0a40a-b7ed-43b9-84c4-130af672d1b1] Detach interface failed, port_id=18fe908a-fccb-4a7d-ab1d-d5b05ab0f20d, reason: Instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:37:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:42 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Deleted allocations for instance 4aa0a40a-b7ed-43b9-84c4-130af672d1b1
Nov 10 19:37:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d1568587-fdf7-40d5-b437-b1d126bed69a tempest-AttachVolumeNegativeTest-1780662801 tempest-AttachVolumeNegativeTest-1780662801-project-member] Lock "4aa0a40a-b7ed-43b9-84c4-130af672d1b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.604s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:37:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:37:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Instance spawned successfully.
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:37:43 user nova-compute[75026]: INFO nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-0d41780d-ab1a-41ac-9e52-800ce52f2c45 req-4fc66be6-bcff-4b88-bdbe-b73e8eb999df service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0d41780d-ab1a-41ac-9e52-800ce52f2c45 req-4fc66be6-bcff-4b88-bdbe-b73e8eb999df service nova] Acquiring lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0d41780d-ab1a-41ac-9e52-800ce52f2c45 req-4fc66be6-bcff-4b88-bdbe-b73e8eb999df service nova] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0d41780d-ab1a-41ac-9e52-800ce52f2c45 req-4fc66be6-bcff-4b88-bdbe-b73e8eb999df service nova] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-0d41780d-ab1a-41ac-9e52-800ce52f2c45 req-4fc66be6-bcff-4b88-bdbe-b73e8eb999df service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] No waiting events found dispatching network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:37:43 user nova-compute[75026]: WARNING nova.compute.manager [req-0d41780d-ab1a-41ac-9e52-800ce52f2c45 req-4fc66be6-bcff-4b88-bdbe-b73e8eb999df service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received unexpected event network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c for instance with vm_state building and task_state spawning.
Nov 10 19:37:43 user nova-compute[75026]: INFO nova.compute.manager [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Took 31.78 seconds to build instance.
Nov 10 19:37:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-89c8e006-27b6-477e-a63f-7f91d5522ca1 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.891s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:37:44 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Snapshot image upload complete
Nov 10 19:37:44 user nova-compute[75026]: INFO nova.compute.manager [None req-4c96b645-c2f0-4291-a8bc-3604a93496f5 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Took 6.17 seconds to snapshot the instance on the hypervisor.
Nov 10 19:37:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:48 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 is timed out.
Nov 10 19:37:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully detached device vdb from instance 2a333e19-c760-441d-bb5a-392d1f25b7e1 from the live domain config.
Nov 10 19:37:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xijQJufp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:37:48 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e83dc-5767-4399-b6bc-ab01208b0bec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:37:48 user nova-compute[75026]: No targets found.
Nov 10 19:37:48 user nova-compute[75026]: iSNS:
Nov 10 19:37:48 user nova-compute[75026]: No targets found.
Nov 10 19:37:48 user nova-compute[75026]: STATIC:
Nov 10 19:37:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0
Nov 10 19:37:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:37:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:37:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8
Nov 10 19:37:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:37:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:37:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:37:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:37:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:37:48 user nova-compute[75026]: FIRMWARE:
Nov 10 19:37:48 user nova-compute[75026]: No targets found.
Nov 10 19:37:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:37:48 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:37:48 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e455f200-e2ec-4a6f-8e2b-7e5f3337e418]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b799c242-2fa1-4374-a207-22ad90adb359]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:37:48 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:37:48 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:37:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:37:48 user nova-compute[75026]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 (non-flash)
Nov 10 19:37:48 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:37:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed803bed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31000e9-24cd-4644-8cf5-6ffab75047a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3beb87c-bf4e-40f6-b8b4-1fac19468a4e]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a0eef7-b7e8-42ee-ab03-16410f7e2d26]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2147ce0f-1642-45bd-a692-772c18fc800d]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[411ca1a6-9c7e-4b7a-97ba-fc2fd39ad78c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f6860-d1f3-49f6-9fb6-c935a246389b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260]
Nov 10 19:37:48 user nova-compute[75026]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8, portal: 172.16.0.220,3260] successful.
Nov 10 19:37:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edc5d51-750e-410a-b239-d87b34d2c6a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[613e2f92-e9d4-4320-b3af-7a366085e5f3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== disconnect_volume: return (320ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:37:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:37:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:37:59 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'flavor' on Instance uuid 2a333e19-c760-441d-bb5a-392d1f25b7e1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:37:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ea800981-20b3-42ca-96c2-927c71a4e0e0 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.706s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:15 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:19 user nova-compute[75026]: INFO nova.compute.manager [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Terminating instance
Nov 10 19:38:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:38:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-6215ea18-3bce-4fe6-b77a-a778f6faf944 req-65ef60cc-9883-4162-afdd-07aa26381f60 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6215ea18-3bce-4fe6-b77a-a778f6faf944 req-65ef60cc-9883-4162-afdd-07aa26381f60 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6215ea18-3bce-4fe6-b77a-a778f6faf944 req-65ef60cc-9883-4162-afdd-07aa26381f60 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6215ea18-3bce-4fe6-b77a-a778f6faf944 req-65ef60cc-9883-4162-afdd-07aa26381f60 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-6215ea18-3bce-4fe6-b77a-a778f6faf944 req-65ef60cc-9883-4162-afdd-07aa26381f60 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:38:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-6215ea18-3bce-4fe6-b77a-a778f6faf944 req-65ef60cc-9883-4162-afdd-07aa26381f60 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Instance destroyed successfully.
Nov 10 19:38:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG nova.objects.instance [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'resources' on Instance uuid 2a333e19-c760-441d-bb5a-392d1f25b7e1 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:31:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-15317474',display_name='tempest-ServerActionsTestOtherA-server-555049719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-15317474',id=29,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANKbmnJLhIy/JKEN3OUfXLEG+Pdi5x/Nbfoi2d/gtVja3l6VtbaoyIkgBlAg41imqPAl5Eg9ZNth0ngB2O9LrKDF6yeH1SbrpemISX9AjOc/LDw0Q1j8cyQSpAhDjhMLg==',key_name='tempest-keypair-614238469',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-r30cb6r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=2a333e19-c760-441d-bb5a-392d1f25b7e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "address": "fa:16:3e:31:29:5a", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc38295a-d9", "ovs_interfaceid": "fc38295a-d9ab-42e2-83c7-8623dc67f022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG os_vif [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc38295a-d9, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a14b0f66-80ad-497c-ac60-3c3d1be67e2b) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:38:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:22 user nova-compute[75026]: INFO os_vif [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:29:5a,bridge_name='br-int',has_traffic_filtering=True,id=fc38295a-d9ab-42e2-83c7-8623dc67f022,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc38295a-d9')
Nov 10 19:38:22 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Deleting instance files /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1_del
Nov 10 19:38:22 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Deletion of /opt/stack/data/nova/instances/2a333e19-c760-441d-bb5a-392d1f25b7e1_del complete
Nov 10 19:38:22 user nova-compute[75026]: INFO nova.compute.manager [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Took 2.84 seconds to destroy the instance on the hypervisor.
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:38:22 user nova-compute[75026]: WARNING nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state active and task_state deleting.
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:38:22 user nova-compute[75026]: WARNING nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state active and task_state deleting.
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:38:22 user nova-compute[75026]: WARNING nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state active and task_state deleting.
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-fee79141-e2f4-4bff-ba5c-603311f3cc46 req-f1d0d1bd-1a1e-493a-a88e-1da7090fd6f9 service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-unplugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:22 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:38:23 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Took 0.88 seconds to deallocate network for instance.
Nov 10 19:38:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:38:23 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid '2a333e19-c760-441d-bb5a-392d1f25b7e1' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid '2a333e19-c760-441d-bb5a-392d1f25b7e1' (instance-0000001d)
Nov 10 19:38:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-9f22eff3-5002-47d6-af03-6fa1811d0814 req-52b337d3-7286-4511-852b-d429f763c85d service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-deleted-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:23 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:38:23 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:38:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8260MB free_disk=24.35395050048828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:38:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.964s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.112s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:24 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Deleted allocations for instance 2a333e19-c760-441d-bb5a-392d1f25b7e1
Nov 10 19:38:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6c231234-213e-4c21-aaf4-bd368807854f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.908s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-95caf4be-0712-4346-8a6e-7727ab71890d req-5194b43c-c0a6-4dff-8625-4bbfcb760c0a service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-95caf4be-0712-4346-8a6e-7727ab71890d req-5194b43c-c0a6-4dff-8625-4bbfcb760c0a service nova] Acquiring lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-95caf4be-0712-4346-8a6e-7727ab71890d req-5194b43c-c0a6-4dff-8625-4bbfcb760c0a service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-95caf4be-0712-4346-8a6e-7727ab71890d req-5194b43c-c0a6-4dff-8625-4bbfcb760c0a service nova] Lock "2a333e19-c760-441d-bb5a-392d1f25b7e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-95caf4be-0712-4346-8a6e-7727ab71890d req-5194b43c-c0a6-4dff-8625-4bbfcb760c0a service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] No waiting events found dispatching network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:38:24 user nova-compute[75026]: WARNING nova.compute.manager [req-95caf4be-0712-4346-8a6e-7727ab71890d req-5194b43c-c0a6-4dff-8625-4bbfcb760c0a service nova] [instance: 2a333e19-c760-441d-bb5a-392d1f25b7e1] Received unexpected event network-vif-plugged-fc38295a-d9ab-42e2-83c7-8623dc67f022 for instance with vm_state deleted and task_state None.
Nov 10 19:38:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:38:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:38:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:38:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:38:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:27 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:38:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:38:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:38:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:38:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:38:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:38:39 user nova-compute[75026]: INFO nova.compute.claims [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Claim successful on node user
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:38:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.policy [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '442ec391b55f49fd8bf04a9a4d175557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18a8d5506ea4c5397e100334afb623c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:38:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Creating image(s)
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "/opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "/opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "/opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.226s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.237s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk 1073741824" returned: 0 in 0.080s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Successfully created port: 9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.217s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Cannot resize image /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Ensure instance console log exists: /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Successfully updated port: 9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquired lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-e8b41840-4e79-4bfe-99b7-ad5f02e4b12a req-96ce8770-0b56-428d-8f1f-04ce580f4f93 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received event network-changed-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-e8b41840-4e79-4bfe-99b7-ad5f02e4b12a req-96ce8770-0b56-428d-8f1f-04ce580f4f93 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Refreshing instance network info cache due to event network-changed-9d44a002-8ee9-4be7-b437-cf08ff9119d7. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e8b41840-4e79-4bfe-99b7-ad5f02e4b12a req-96ce8770-0b56-428d-8f1f-04ce580f4f93 service nova] Acquiring lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Updating instance_info_cache with network_info: [{"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Releasing lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Instance network_info: |[{"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e8b41840-4e79-4bfe-99b7-ad5f02e4b12a req-96ce8770-0b56-428d-8f1f-04ce580f4f93 service nova] Acquired lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-e8b41840-4e79-4bfe-99b7-ad5f02e4b12a req-96ce8770-0b56-428d-8f1f-04ce580f4f93 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Refreshing network info cache for port 9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Start _get_guest_xml network_info=[{"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:38:42 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:38:42 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:38:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-770123529',display_name='tempest-TestServerVolumeAttachmentScenario-server-770123529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-770123529',id=36,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvMILOkHszM+kMMCQrOX6JeeQsCXqVWh4wODtwh1G6yAIZBKQknxWtlQmClNSch4AA3f9vMjSFa8YfExaJDIlh02/osZdI7GVTAzq/4RyI4FEgQhg2oaoJLCfOx9CIdUw==',key_name='tempest-keypair-569313212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f18a8d5506ea4c5397e100334afb623c',ramdisk_id='',reservation_id='r-o0lyeqe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-382703458',owner_user_name='tempest-TestServerVolumeAttachmentScenario-382703458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442ec391b55f49fd8bf04a9a4d175557',uuid=e16d4fd8-931a-43b2-aca8-45b6c2b571a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Converting VIF {"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=9d44a002-8ee9-4be7-b437-cf08ff9119d7,network=Network(1da42e85-0296-44df-ab02-3eea80ea01dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d44a002-8e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.objects.instance [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lazy-loading 'pci_devices' on Instance uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:38:42 user nova-compute[75026]:   <uuid>e16d4fd8-931a-43b2-aca8-45b6c2b571a3</uuid>
Nov 10 19:38:42 user nova-compute[75026]:   <name>instance-00000024</name>
Nov 10 19:38:42 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:38:42 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:38:42 user nova-compute[75026]:   <metadata>
Nov 10 19:38:42 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:38:42 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:38:42 user nova-compute[75026]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-770123529</nova:name>
Nov 10 19:38:42 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:38:42</nova:creationTime>
Nov 10 19:38:42 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:38:42 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:38:42 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:38:42 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:38:42 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:38:42 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:38:42 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:38:42 user nova-compute[75026]:       <nova:owner>
Nov 10 19:38:42 user nova-compute[75026]:         <nova:user uuid="442ec391b55f49fd8bf04a9a4d175557">tempest-TestServerVolumeAttachmentScenario-382703458-project-member</nova:user>
Nov 10 19:38:42 user nova-compute[75026]:         <nova:project uuid="f18a8d5506ea4c5397e100334afb623c">tempest-TestServerVolumeAttachmentScenario-382703458</nova:project>
Nov 10 19:38:42 user nova-compute[75026]:       </nova:owner>
Nov 10 19:38:42 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:38:42 user nova-compute[75026]:       <nova:ports>
Nov 10 19:38:42 user nova-compute[75026]:         <nova:port uuid="9d44a002-8ee9-4be7-b437-cf08ff9119d7">
Nov 10 19:38:42 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 19:38:42 user nova-compute[75026]:         </nova:port>
Nov 10 19:38:42 user nova-compute[75026]:       </nova:ports>
Nov 10 19:38:42 user nova-compute[75026]:     </nova:instance>
Nov 10 19:38:42 user nova-compute[75026]:   </metadata>
Nov 10 19:38:42 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:38:42 user nova-compute[75026]:     <system>
Nov 10 19:38:42 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:38:42 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:38:42 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:38:42 user nova-compute[75026]:       <entry name="serial">e16d4fd8-931a-43b2-aca8-45b6c2b571a3</entry>
Nov 10 19:38:42 user nova-compute[75026]:       <entry name="uuid">e16d4fd8-931a-43b2-aca8-45b6c2b571a3</entry>
Nov 10 19:38:42 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:38:42 user nova-compute[75026]:     </system>
Nov 10 19:38:42 user nova-compute[75026]:   </sysinfo>
Nov 10 19:38:42 user nova-compute[75026]:   <os>
Nov 10 19:38:42 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:38:42 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:38:42 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:38:42 user nova-compute[75026]:   </os>
Nov 10 19:38:42 user nova-compute[75026]:   <features>
Nov 10 19:38:42 user nova-compute[75026]:     <acpi/>
Nov 10 19:38:42 user nova-compute[75026]:     <apic/>
Nov 10 19:38:42 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:38:42 user nova-compute[75026]:   </features>
Nov 10 19:38:42 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:38:42 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:38:42 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:38:42 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:38:42 user nova-compute[75026]:   </clock>
Nov 10 19:38:42 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:38:42 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:38:42 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:38:42 user nova-compute[75026]:   </cpu>
Nov 10 19:38:42 user nova-compute[75026]:   <devices>
Nov 10 19:38:42 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:38:42 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:38:42 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk"/>
Nov 10 19:38:42 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:38:42 user nova-compute[75026]:     </disk>
Nov 10 19:38:42 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:38:42 user nova-compute[75026]:       <mac address="fa:16:3e:d2:2e:9f"/>
Nov 10 19:38:42 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:38:42 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:38:42 user nova-compute[75026]:       <target dev="tap9d44a002-8e"/>
Nov 10 19:38:42 user nova-compute[75026]:     </interface>
Nov 10 19:38:42 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:38:42 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/console.log" append="off"/>
Nov 10 19:38:42 user nova-compute[75026]:     </serial>
Nov 10 19:38:42 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:38:42 user nova-compute[75026]:     <video>
Nov 10 19:38:42 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:38:42 user nova-compute[75026]:     </video>
Nov 10 19:38:42 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:38:42 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:38:42 user nova-compute[75026]:     </rng>
Nov 10 19:38:42 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:38:42 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:38:42 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:38:42 user nova-compute[75026]:     </memballoon>
Nov 10 19:38:42 user nova-compute[75026]:   </devices>
Nov 10 19:38:42 user nova-compute[75026]: </domain>
Nov 10 19:38:42 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:38:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-770123529',display_name='tempest-TestServerVolumeAttachmentScenario-server-770123529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-770123529',id=36,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvMILOkHszM+kMMCQrOX6JeeQsCXqVWh4wODtwh1G6yAIZBKQknxWtlQmClNSch4AA3f9vMjSFa8YfExaJDIlh02/osZdI7GVTAzq/4RyI4FEgQhg2oaoJLCfOx9CIdUw==',key_name='tempest-keypair-569313212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f18a8d5506ea4c5397e100334afb623c',ramdisk_id='',reservation_id='r-o0lyeqe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-382703458',owner_user_name='tempest-TestServerVolumeAttachmentScenario-382703458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442ec391b55f49fd8bf04a9a4d175557',uuid=e16d4fd8-931a-43b2-aca8-45b6c2b571a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Converting VIF {"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=9d44a002-8ee9-4be7-b437-cf08ff9119d7,network=Network(1da42e85-0296-44df-ab02-3eea80ea01dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d44a002-8e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG os_vif [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=9d44a002-8ee9-4be7-b437-cf08ff9119d7,network=Network(1da42e85-0296-44df-ab02-3eea80ea01dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d44a002-8e') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea5bc8f9-93d8-5d18-a4ac-ef261f5e7634', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d44a002-8e, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d44a002-8e, col_values=(('qos', UUID('2897c995-e2ec-43a7-97d2-ad3c02ad515b')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d44a002-8e, col_values=(('external_ids', {'iface-id': '9d44a002-8ee9-4be7-b437-cf08ff9119d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:2e:9f', 'vm-uuid': 'e16d4fd8-931a-43b2-aca8-45b6c2b571a3'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:42 user nova-compute[75026]: INFO os_vif [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=9d44a002-8ee9-4be7-b437-cf08ff9119d7,network=Network(1da42e85-0296-44df-ab02-3eea80ea01dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d44a002-8e')
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No VIF found with MAC fa:16:3e:d2:2e:9f, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-e8b41840-4e79-4bfe-99b7-ad5f02e4b12a req-96ce8770-0b56-428d-8f1f-04ce580f4f93 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Updated VIF entry in instance network info cache for port 9d44a002-8ee9-4be7-b437-cf08ff9119d7. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-e8b41840-4e79-4bfe-99b7-ad5f02e4b12a req-96ce8770-0b56-428d-8f1f-04ce580f4f93 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Updating instance_info_cache with network_info: [{"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:38:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e8b41840-4e79-4bfe-99b7-ad5f02e4b12a req-96ce8770-0b56-428d-8f1f-04ce580f4f93 service nova] Releasing lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:38:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-caa88b42-e24e-4842-8e31-e277515ea871 req-b0082128-556e-4c9c-a25e-2d32b0365d57 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received event network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-caa88b42-e24e-4842-8e31-e277515ea871 req-b0082128-556e-4c9c-a25e-2d32b0365d57 service nova] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-caa88b42-e24e-4842-8e31-e277515ea871 req-b0082128-556e-4c9c-a25e-2d32b0365d57 service nova] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-caa88b42-e24e-4842-8e31-e277515ea871 req-b0082128-556e-4c9c-a25e-2d32b0365d57 service nova] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-caa88b42-e24e-4842-8e31-e277515ea871 req-b0082128-556e-4c9c-a25e-2d32b0365d57 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] No waiting events found dispatching network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:38:44 user nova-compute[75026]: WARNING nova.compute.manager [req-caa88b42-e24e-4842-8e31-e277515ea871 req-b0082128-556e-4c9c-a25e-2d32b0365d57 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received unexpected event network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 for instance with vm_state building and task_state spawning.
Nov 10 19:38:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-111d5ae1-90be-4042-b142-3c3571bf3b56 req-cde01374-b4da-4b29-aa04-90cee3ffadb5 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received event network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-111d5ae1-90be-4042-b142-3c3571bf3b56 req-cde01374-b4da-4b29-aa04-90cee3ffadb5 service nova] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-111d5ae1-90be-4042-b142-3c3571bf3b56 req-cde01374-b4da-4b29-aa04-90cee3ffadb5 service nova] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-111d5ae1-90be-4042-b142-3c3571bf3b56 req-cde01374-b4da-4b29-aa04-90cee3ffadb5 service nova] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-111d5ae1-90be-4042-b142-3c3571bf3b56 req-cde01374-b4da-4b29-aa04-90cee3ffadb5 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] No waiting events found dispatching network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:38:46 user nova-compute[75026]: WARNING nova.compute.manager [req-111d5ae1-90be-4042-b142-3c3571bf3b56 req-cde01374-b4da-4b29-aa04-90cee3ffadb5 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received unexpected event network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 for instance with vm_state building and task_state spawning.
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:38:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Instance spawned successfully.
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:38:46 user nova-compute[75026]: INFO nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:38:46 user nova-compute[75026]: INFO nova.compute.manager [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Took 7.36 seconds to build instance.
Nov 10 19:38:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-bffe0725-c15d-441f-aa6b-f702031303f2 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.484s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:38:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:38:46 user nova-compute[75026]: INFO nova.compute.claims [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Claim successful on node user
Nov 10 19:38:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:47 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:38:47 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:38:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:38:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:38:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:38:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:38:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:38:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:38:47 user nova-compute[75026]: DEBUG nova.policy [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcbd2be26ec84b5d9f6f6638963e870e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e468483e8f4f70bd228ff8194d76b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:38:47 user nova-compute[75026]: INFO nova.virt.block_device [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Booting with volume-backed-image da817026-309f-4431-a8d4-b6d8e64853b2 at /dev/vda
Nov 10 19:38:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Successfully created port: 38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Successfully updated port: 38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquired lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-d6b7be5b-8540-4338-9a29-06a4f4349539 req-0eec7a72-4735-4f87-a576-3598833a8845 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-changed-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-d6b7be5b-8540-4338-9a29-06a4f4349539 req-0eec7a72-4735-4f87-a576-3598833a8845 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Refreshing instance network info cache due to event network-changed-38091bf6-30e8-4cb1-8aa6-ccf0d388b584. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d6b7be5b-8540-4338-9a29-06a4f4349539 req-0eec7a72-4735-4f87-a576-3598833a8845 service nova] Acquiring lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Updating instance_info_cache with network_info: [{"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Releasing lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance network_info: |[{"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d6b7be5b-8540-4338-9a29-06a4f4349539 req-0eec7a72-4735-4f87-a576-3598833a8845 service nova] Acquired lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-d6b7be5b-8540-4338-9a29-06a4f4349539 req-0eec7a72-4735-4f87-a576-3598833a8845 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Refreshing network info cache for port 38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-d6b7be5b-8540-4338-9a29-06a4f4349539 req-0eec7a72-4735-4f87-a576-3598833a8845 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Updated VIF entry in instance network info cache for port 38091bf6-30e8-4cb1-8aa6-ccf0d388b584. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-d6b7be5b-8540-4338-9a29-06a4f4349539 req-0eec7a72-4735-4f87-a576-3598833a8845 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Updating instance_info_cache with network_info: [{"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:38:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d6b7be5b-8540-4338-9a29-06a4f4349539 req-0eec7a72-4735-4f87-a576-3598833a8845 service nova] Releasing lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:38:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:38:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:38:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:38:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:38:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:38:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:38:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:39:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-3bf414c4-883a-492c-9dfa-a1c5531b7321 req-e9a02e44-e281-4519-b8f6-dac5836b54ab service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-changed-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:39:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-3bf414c4-883a-492c-9dfa-a1c5531b7321 req-e9a02e44-e281-4519-b8f6-dac5836b54ab service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Refreshing instance network info cache due to event network-changed-59405ecb-8bc7-45a9-b819-880c218ed01c. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:39:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3bf414c4-883a-492c-9dfa-a1c5531b7321 req-e9a02e44-e281-4519-b8f6-dac5836b54ab service nova] Acquiring lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:39:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3bf414c4-883a-492c-9dfa-a1c5531b7321 req-e9a02e44-e281-4519-b8f6-dac5836b54ab service nova] Acquired lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:39:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-3bf414c4-883a-492c-9dfa-a1c5531b7321 req-e9a02e44-e281-4519-b8f6-dac5836b54ab service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Refreshing network info cache for port 59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:39:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-3bf414c4-883a-492c-9dfa-a1c5531b7321 req-e9a02e44-e281-4519-b8f6-dac5836b54ab service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updated VIF entry in instance network info cache for port 59405ecb-8bc7-45a9-b819-880c218ed01c. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:39:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-3bf414c4-883a-492c-9dfa-a1c5531b7321 req-e9a02e44-e281-4519-b8f6-dac5836b54ab service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updating instance_info_cache with network_info: [{"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:39:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3bf414c4-883a-492c-9dfa-a1c5531b7321 req-e9a02e44-e281-4519-b8f6-dac5836b54ab service nova] Releasing lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:39:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:18 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:39:20 user nova-compute[75026]: INFO nova.compute.claims [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Claim successful on node user
Nov 10 19:39:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:39:20 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:39:20 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:39:20 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG nova.policy [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68746f97690e4928acbcade25680b895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1772dacf6532415e9fad0345cc6b6f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:39:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Creating image(s)
Nov 10 19:39:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "/opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "/opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "/opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "c9ce355cc23e36dab2e8d69d0cfe8c32a118b160" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "c9ce355cc23e36dab2e8d69d0cfe8c32a118b160" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG nova.virt.images [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] 201ce38e-7d35-40dd-97ac-e4300b00561a was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160.part /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:21 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Successfully created port: 11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160.part /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160.converted" returned: 0 in 0.510s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "c9ce355cc23e36dab2e8d69d0cfe8c32a118b160" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.415s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 --force-share --output=json" returned: 0 in 0.221s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "c9ce355cc23e36dab2e8d69d0cfe8c32a118b160" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "c9ce355cc23e36dab2e8d69d0cfe8c32a118b160" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 --force-share --output=json" returned: 0 in 0.208s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160,backing_fmt=raw /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160,backing_fmt=raw /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk 1073741824" returned: 0 in 0.059s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "c9ce355cc23e36dab2e8d69d0cfe8c32a118b160" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Successfully updated port: 11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 --force-share --output=json" returned: 0 in 0.211s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquired lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-022bb6ed-53c4-4e8e-9107-fbcdaeebe1ad req-48e4accf-a28b-47aa-b2b7-6d9bf5561da4 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-022bb6ed-53c4-4e8e-9107-fbcdaeebe1ad req-48e4accf-a28b-47aa-b2b7-6d9bf5561da4 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing instance network info cache due to event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-022bb6ed-53c4-4e8e-9107-fbcdaeebe1ad req-48e4accf-a28b-47aa-b2b7-6d9bf5561da4 service nova] Acquiring lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Cannot resize image /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Ensure instance console log exists: /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Releasing lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Instance network_info: |[{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-022bb6ed-53c4-4e8e-9107-fbcdaeebe1ad req-48e4accf-a28b-47aa-b2b7-6d9bf5561da4 service nova] Acquired lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.neutron [req-022bb6ed-53c4-4e8e-9107-fbcdaeebe1ad req-48e4accf-a28b-47aa-b2b7-6d9bf5561da4 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Start _get_guest_xml network_info=[{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:39:17Z,direct_url=<?>,disk_format='qcow2',id=201ce38e-7d35-40dd-97ac-e4300b00561a,min_disk=0,min_ram=0,name='tempest-scenario-img--468776365',owner='1772dacf6532415e9fad0345cc6b6f8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:39:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': '201ce38e-7d35-40dd-97ac-e4300b00561a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:39:23 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:39:23 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:39:17Z,direct_url=<?>,disk_format='qcow2',id=201ce38e-7d35-40dd-97ac-e4300b00561a,min_disk=0,min_ram=0,name='tempest-scenario-img--468776365',owner='1772dacf6532415e9fad0345cc6b6f8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:39:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-697677391',display_name='tempest-TestMinimumBasicScenario-server-697677391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-697677391',id=38,image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9iJhoV2AQmlb4E4tOUu9pK1P1y6TbuVhEZHslkEnMBCG7TKJFJgekMxSamW7Co3bXviUcXuGTmeD65Hic4t5VK0PflhuWDH2hlMRNB1YnAgAuReT6a+kjcydoJxWNbyg==',key_name='tempest-TestMinimumBasicScenario-1209618325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-3yzzzsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:39:21Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=352c397d-7e92-4b2c-8e4a-9482c4b74326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'pci_devices' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG os_brick.utils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:39:23 user nova-compute[75026]:   <uuid>352c397d-7e92-4b2c-8e4a-9482c4b74326</uuid>
Nov 10 19:39:23 user nova-compute[75026]:   <name>instance-00000026</name>
Nov 10 19:39:23 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:39:23 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:39:23 user nova-compute[75026]:   <metadata>
Nov 10 19:39:23 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:39:23 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:39:23 user nova-compute[75026]:       <nova:name>tempest-TestMinimumBasicScenario-server-697677391</nova:name>
Nov 10 19:39:23 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:39:23</nova:creationTime>
Nov 10 19:39:23 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:39:23 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:39:23 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:39:23 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:39:23 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:39:23 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:39:23 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:39:23 user nova-compute[75026]:       <nova:owner>
Nov 10 19:39:23 user nova-compute[75026]:         <nova:user uuid="68746f97690e4928acbcade25680b895">tempest-TestMinimumBasicScenario-966338622-project-member</nova:user>
Nov 10 19:39:23 user nova-compute[75026]:         <nova:project uuid="1772dacf6532415e9fad0345cc6b6f8f">tempest-TestMinimumBasicScenario-966338622</nova:project>
Nov 10 19:39:23 user nova-compute[75026]:       </nova:owner>
Nov 10 19:39:23 user nova-compute[75026]:       <nova:root type="image" uuid="201ce38e-7d35-40dd-97ac-e4300b00561a"/>
Nov 10 19:39:23 user nova-compute[75026]:       <nova:ports>
Nov 10 19:39:23 user nova-compute[75026]:         <nova:port uuid="11d38f14-6245-494b-b6c1-a80f36322ded">
Nov 10 19:39:23 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 19:39:23 user nova-compute[75026]:         </nova:port>
Nov 10 19:39:23 user nova-compute[75026]:       </nova:ports>
Nov 10 19:39:23 user nova-compute[75026]:     </nova:instance>
Nov 10 19:39:23 user nova-compute[75026]:   </metadata>
Nov 10 19:39:23 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:39:23 user nova-compute[75026]:     <system>
Nov 10 19:39:23 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:39:23 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:39:23 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:39:23 user nova-compute[75026]:       <entry name="serial">352c397d-7e92-4b2c-8e4a-9482c4b74326</entry>
Nov 10 19:39:23 user nova-compute[75026]:       <entry name="uuid">352c397d-7e92-4b2c-8e4a-9482c4b74326</entry>
Nov 10 19:39:23 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:39:23 user nova-compute[75026]:     </system>
Nov 10 19:39:23 user nova-compute[75026]:   </sysinfo>
Nov 10 19:39:23 user nova-compute[75026]:   <os>
Nov 10 19:39:23 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:39:23 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:39:23 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:39:23 user nova-compute[75026]:   </os>
Nov 10 19:39:23 user nova-compute[75026]:   <features>
Nov 10 19:39:23 user nova-compute[75026]:     <acpi/>
Nov 10 19:39:23 user nova-compute[75026]:     <apic/>
Nov 10 19:39:23 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:39:23 user nova-compute[75026]:   </features>
Nov 10 19:39:23 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:39:23 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:39:23 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:39:23 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:39:23 user nova-compute[75026]:   </clock>
Nov 10 19:39:23 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:39:23 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:39:23 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:39:23 user nova-compute[75026]:   </cpu>
Nov 10 19:39:23 user nova-compute[75026]:   <devices>
Nov 10 19:39:23 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:39:23 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:39:23 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk"/>
Nov 10 19:39:23 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:39:23 user nova-compute[75026]:     </disk>
Nov 10 19:39:23 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:39:23 user nova-compute[75026]:       <mac address="fa:16:3e:03:c4:a6"/>
Nov 10 19:39:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:39:23 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:39:23 user nova-compute[75026]:       <target dev="tap11d38f14-62"/>
Nov 10 19:39:23 user nova-compute[75026]:     </interface>
Nov 10 19:39:23 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:39:23 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/console.log" append="off"/>
Nov 10 19:39:23 user nova-compute[75026]:     </serial>
Nov 10 19:39:23 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:39:23 user nova-compute[75026]:     <video>
Nov 10 19:39:23 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:39:23 user nova-compute[75026]:     </video>
Nov 10 19:39:23 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:39:23 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:39:23 user nova-compute[75026]:     </rng>
Nov 10 19:39:23 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:39:23 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:39:23 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:39:23 user nova-compute[75026]:     </memballoon>
Nov 10 19:39:23 user nova-compute[75026]:   </devices>
Nov 10 19:39:23 user nova-compute[75026]: </domain>
Nov 10 19:39:23 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-697677391',display_name='tempest-TestMinimumBasicScenario-server-697677391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-697677391',id=38,image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9iJhoV2AQmlb4E4tOUu9pK1P1y6TbuVhEZHslkEnMBCG7TKJFJgekMxSamW7Co3bXviUcXuGTmeD65Hic4t5VK0PflhuWDH2hlMRNB1YnAgAuReT6a+kjcydoJxWNbyg==',key_name='tempest-TestMinimumBasicScenario-1209618325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-3yzzzsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:39:21Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=352c397d-7e92-4b2c-8e4a-9482c4b74326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG os_vif [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bb925ce-f879-5830-a11a-c4f377b591f8', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11d38f14-62, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11d38f14-62, col_values=(('qos', UUID('5cfd014e-82f9-4afb-91d4-8f237c422f65')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11d38f14-62, col_values=(('external_ids', {'iface-id': '11d38f14-6245-494b-b6c1-a80f36322ded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:c4:a6', 'vm-uuid': '352c397d-7e92-4b2c-8e4a-9482c4b74326'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[806d668e-b632-49e3-8682-892a41260cb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:23 user nova-compute[75026]: INFO os_vif [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62')
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16713451-a3bf-40ce-8dbf-e09941180e43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6301ec4-24a0-4e43-883d-8b68372b5cc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1c3435-ebcb-4ce2-89b7-383f41512995]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:39:24 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223601a-09e2-459a-be3c-93765ae640b4]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG os_brick.utils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Updating existing volume attachment record: ab702487-e491-4e8a-9892-e8882e0cf32f {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No VIF found with MAC fa:16:3e:03:c4:a6, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "8da60c29-7705-4267-acb1-4e32406a7699" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8da60c29-7705-4267-acb1-4e32406a7699" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG nova.network.neutron [req-022bb6ed-53c4-4e8e-9107-fbcdaeebe1ad req-48e4accf-a28b-47aa-b2b7-6d9bf5561da4 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updated VIF entry in instance network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG nova.network.neutron [req-022bb6ed-53c4-4e8e-9107-fbcdaeebe1ad req-48e4accf-a28b-47aa-b2b7-6d9bf5561da4 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-022bb6ed-53c4-4e8e-9107-fbcdaeebe1ad req-48e4accf-a28b-47aa-b2b7-6d9bf5561da4 service nova] Releasing lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:39:24 user nova-compute[75026]: INFO nova.compute.claims [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Claim successful on node user
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:39:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.policy [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '758478b59f94467898696fa7af7cd630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e509e662d27146fba4f51fd55dbe6f83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:25 user nova-compute[75026]: INFO nova.virt.block_device [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Booting with volume 50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a at /dev/vda
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG os_brick.utils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfe07db-9110-41bf-9c49-6eaa81e1ff23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a33b01e-c1de-4ffb-abf7-d0f6b0585af0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcca177-195f-48e5-91ce-0acad8ad4151]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[844dfafa-ba41-48ac-a31b-70b5b77f9b41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:39:25 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecddf579-b56b-4db0-b50d-684ebc7d4ddc]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG os_brick.utils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updating existing volume attachment record: 09551730-e92c-48f1-b211-f6adea72d588 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Successfully created port: 714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-f082a37f-8bb9-4f23-9d2f-4aeba66e6696 req-e356f68c-7c7c-40c4-b1a3-65ea89be6ed1 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f082a37f-8bb9-4f23-9d2f-4aeba66e6696 req-e356f68c-7c7c-40c4-b1a3-65ea89be6ed1 service nova] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f082a37f-8bb9-4f23-9d2f-4aeba66e6696 req-e356f68c-7c7c-40c4-b1a3-65ea89be6ed1 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f082a37f-8bb9-4f23-9d2f-4aeba66e6696 req-e356f68c-7c7c-40c4-b1a3-65ea89be6ed1 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-f082a37f-8bb9-4f23-9d2f-4aeba66e6696 req-e356f68c-7c7c-40c4-b1a3-65ea89be6ed1 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] No waiting events found dispatching network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:39:28 user nova-compute[75026]: WARNING nova.compute.manager [req-f082a37f-8bb9-4f23-9d2f-4aeba66e6696 req-e356f68c-7c7c-40c4-b1a3-65ea89be6ed1 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received unexpected event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded for instance with vm_state building and task_state spawning.
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-b1b44e0d-0be6-4e3a-8b2d-f5d29784f4d8 req-120f425b-9fbc-4187-aa8d-3f3ce2ea37bf service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b1b44e0d-0be6-4e3a-8b2d-f5d29784f4d8 req-120f425b-9fbc-4187-aa8d-3f3ce2ea37bf service nova] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b1b44e0d-0be6-4e3a-8b2d-f5d29784f4d8 req-120f425b-9fbc-4187-aa8d-3f3ce2ea37bf service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b1b44e0d-0be6-4e3a-8b2d-f5d29784f4d8 req-120f425b-9fbc-4187-aa8d-3f3ce2ea37bf service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-b1b44e0d-0be6-4e3a-8b2d-f5d29784f4d8 req-120f425b-9fbc-4187-aa8d-3f3ce2ea37bf service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] No waiting events found dispatching network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:39:28 user nova-compute[75026]: WARNING nova.compute.manager [req-b1b44e0d-0be6-4e3a-8b2d-f5d29784f4d8 req-120f425b-9fbc-4187-aa8d-3f3ce2ea37bf service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received unexpected event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded for instance with vm_state building and task_state spawning.
Nov 10 19:39:28 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Instance spawned successfully.
Nov 10 19:39:28 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:39:28 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8153MB free_disk=25.260143280029297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:28 user nova-compute[75026]: INFO nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Took 7.71 seconds to spawn the instance on the hypervisor.
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b6734c90-d9b3-4705-bb7f-5c5df66e0baf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 8da60c29-7705-4267-acb1-4e32406a7699 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:39:28 user nova-compute[75026]: INFO nova.compute.manager [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Took 8.60 seconds to build instance.
Nov 10 19:39:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fd0b945d-4350-4af1-9f6a-793c40e0bb44 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.729s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.770s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Successfully updated port: 714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquired lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updating instance_info_cache with network_info: [{"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Releasing lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:39:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Instance network_info: |[{"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-9a1186c7-45c0-4ce9-88cd-afd4410ead20 req-e8cc2a44-b513-4108-9e5e-60f41b68af9f service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-changed-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-9a1186c7-45c0-4ce9-88cd-afd4410ead20 req-e8cc2a44-b513-4108-9e5e-60f41b68af9f service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Refreshing instance network info cache due to event network-changed-714e860e-5d76-421e-8c1f-468608d41c0c. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9a1186c7-45c0-4ce9-88cd-afd4410ead20 req-e8cc2a44-b513-4108-9e5e-60f41b68af9f service nova] Acquiring lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9a1186c7-45c0-4ce9-88cd-afd4410ead20 req-e8cc2a44-b513-4108-9e5e-60f41b68af9f service nova] Acquired lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-9a1186c7-45c0-4ce9-88cd-afd4410ead20 req-e8cc2a44-b513-4108-9e5e-60f41b68af9f service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Refreshing network info cache for port 714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-9a1186c7-45c0-4ce9-88cd-afd4410ead20 req-e8cc2a44-b513-4108-9e5e-60f41b68af9f service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updated VIF entry in instance network info cache for port 714e860e-5d76-421e-8c1f-468608d41c0c. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:39:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-9a1186c7-45c0-4ce9-88cd-afd4410ead20 req-e8cc2a44-b513-4108-9e5e-60f41b68af9f service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updating instance_info_cache with network_info: [{"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:39:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9a1186c7-45c0-4ce9-88cd-afd4410ead20 req-e8cc2a44-b513-4108-9e5e-60f41b68af9f service nova] Releasing lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:39:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Updating instance_info_cache with network_info: [{"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:39:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:39:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:39:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:39:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:39:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:39:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Creating image(s)
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Ensure instance console log exists: /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Start _get_guest_xml network_info=[{"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ab702487-e491-4e8a-9892-e8882e0cf32f', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpjVgYPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6734c90-d9b3-4705-bb7f-5c5df66e0baf', 'attached_at': '', 'detached_at': '', 'volume_id': '2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'serial': '2d1f6d1d-e407-44d4-ad38-b1de9f8845a6'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:39:52 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:39:52 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpjVgYPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:39:52 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:39:52 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:39:52 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1261cfc8-3ef9-40f1-855b-a0b1affca759]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:39:52 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a990feed-3f6c-4190-9351-7bcd66bd987d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6] added
Nov 10 19:39:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff0cf3-9936-4b2d-a01f-30b64a3b517f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d63d31-6e0a-4017-a49a-8f5f3b38fd47]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpjVgYPU {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpjVgYPU" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d7324f-c34b-4d77-a2cf-7413958668ef]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wpjVgYPU'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8208ee7d-9e2a-4f55-ad82-301ec235e86c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bcd79b-ac42-4939-80a7-7a47fe3762fb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2916f8-2361-488e-be13-5928cf434594]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6, portal: 172.16.0.220,3260]
Nov 10 19:39:52 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6, portal: 172.16.0.220,3260] successful.
Nov 10 19:39:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6483d35-f4ba-4115-922b-22a8f476d4f9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dbfa09-c797-4038-9129-4267e1d671d8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:39:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d3d90a-d9f3-46e4-920e-0cdf2965ddd6]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:39:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpjVgYPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23361316538653039', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361316538653039', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-591311641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-591311641',id=37,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-d4fcplpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:38:48Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=b6734c90-d9b3-4705-bb7f-5c5df66e0baf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=38091bf6-30e8-4cb1-8aa6-ccf0d388b584,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38091bf6-30') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'pci_devices' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:39:53 user nova-compute[75026]:   <uuid>b6734c90-d9b3-4705-bb7f-5c5df66e0baf</uuid>
Nov 10 19:39:53 user nova-compute[75026]:   <name>instance-00000025</name>
Nov 10 19:39:53 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:39:53 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:39:53 user nova-compute[75026]:   <metadata>
Nov 10 19:39:53 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:39:53 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:39:53 user nova-compute[75026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-591311641</nova:name>
Nov 10 19:39:53 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:39:52</nova:creationTime>
Nov 10 19:39:53 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:39:53 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:39:53 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:39:53 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:39:53 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:39:53 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:39:53 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:39:53 user nova-compute[75026]:       <nova:owner>
Nov 10 19:39:53 user nova-compute[75026]:         <nova:user uuid="fcbd2be26ec84b5d9f6f6638963e870e">tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member</nova:user>
Nov 10 19:39:53 user nova-compute[75026]:         <nova:project uuid="43e468483e8f4f70bd228ff8194d76b7">tempest-ServerBootFromVolumeStableRescueTest-1118157225</nova:project>
Nov 10 19:39:53 user nova-compute[75026]:       </nova:owner>
Nov 10 19:39:53 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:39:53 user nova-compute[75026]:       <nova:ports>
Nov 10 19:39:53 user nova-compute[75026]:         <nova:port uuid="38091bf6-30e8-4cb1-8aa6-ccf0d388b584">
Nov 10 19:39:53 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 19:39:53 user nova-compute[75026]:         </nova:port>
Nov 10 19:39:53 user nova-compute[75026]:       </nova:ports>
Nov 10 19:39:53 user nova-compute[75026]:     </nova:instance>
Nov 10 19:39:53 user nova-compute[75026]:   </metadata>
Nov 10 19:39:53 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:39:53 user nova-compute[75026]:     <system>
Nov 10 19:39:53 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:39:53 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:39:53 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:39:53 user nova-compute[75026]:       <entry name="serial">b6734c90-d9b3-4705-bb7f-5c5df66e0baf</entry>
Nov 10 19:39:53 user nova-compute[75026]:       <entry name="uuid">b6734c90-d9b3-4705-bb7f-5c5df66e0baf</entry>
Nov 10 19:39:53 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:39:53 user nova-compute[75026]:     </system>
Nov 10 19:39:53 user nova-compute[75026]:   </sysinfo>
Nov 10 19:39:53 user nova-compute[75026]:   <os>
Nov 10 19:39:53 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:39:53 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:39:53 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:39:53 user nova-compute[75026]:   </os>
Nov 10 19:39:53 user nova-compute[75026]:   <features>
Nov 10 19:39:53 user nova-compute[75026]:     <acpi/>
Nov 10 19:39:53 user nova-compute[75026]:     <apic/>
Nov 10 19:39:53 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:39:53 user nova-compute[75026]:   </features>
Nov 10 19:39:53 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:39:53 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:39:53 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:39:53 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:39:53 user nova-compute[75026]:   </clock>
Nov 10 19:39:53 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:39:53 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:39:53 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:39:53 user nova-compute[75026]:   </cpu>
Nov 10 19:39:53 user nova-compute[75026]:   <devices>
Nov 10 19:39:53 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:39:53 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:39:53 user nova-compute[75026]:       <source dev="/dev/sdc"/>
Nov 10 19:39:53 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:39:53 user nova-compute[75026]:       <serial>2d1f6d1d-e407-44d4-ad38-b1de9f8845a6</serial>
Nov 10 19:39:53 user nova-compute[75026]:     </disk>
Nov 10 19:39:53 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:39:53 user nova-compute[75026]:       <mac address="fa:16:3e:c8:79:7e"/>
Nov 10 19:39:53 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:39:53 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:39:53 user nova-compute[75026]:       <target dev="tap38091bf6-30"/>
Nov 10 19:39:53 user nova-compute[75026]:     </interface>
Nov 10 19:39:53 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:39:53 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/console.log" append="off"/>
Nov 10 19:39:53 user nova-compute[75026]:     </serial>
Nov 10 19:39:53 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:39:53 user nova-compute[75026]:     <video>
Nov 10 19:39:53 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:39:53 user nova-compute[75026]:     </video>
Nov 10 19:39:53 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:39:53 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:39:53 user nova-compute[75026]:     </rng>
Nov 10 19:39:53 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:39:53 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:39:53 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:39:53 user nova-compute[75026]:     </memballoon>
Nov 10 19:39:53 user nova-compute[75026]:   </devices>
Nov 10 19:39:53 user nova-compute[75026]: </domain>
Nov 10 19:39:53 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-591311641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-591311641',id=37,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-d4fcplpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:38:48Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=b6734c90-d9b3-4705-bb7f-5c5df66e0baf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=38091bf6-30e8-4cb1-8aa6-ccf0d388b584,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38091bf6-30') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG os_vif [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=38091bf6-30e8-4cb1-8aa6-ccf0d388b584,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38091bf6-30') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be66216f-f1ea-5d54-abaf-25811df865cf', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38091bf6-30, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38091bf6-30, col_values=(('qos', UUID('9623f2d1-5ab8-4090-a68b-3f3c6a3e183e')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38091bf6-30, col_values=(('external_ids', {'iface-id': '38091bf6-30e8-4cb1-8aa6-ccf0d388b584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:79:7e', 'vm-uuid': 'b6734c90-d9b3-4705-bb7f-5c5df66e0baf'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:53 user nova-compute[75026]: INFO os_vif [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=38091bf6-30e8-4cb1-8aa6-ccf0d388b584,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38091bf6-30')
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:39:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No VIF found with MAC fa:16:3e:c8:79:7e, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:39:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-d1413e77-9983-4efa-adab-d4624858243d req-9248cff9-0ca8-4037-b376-e92350b82182 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d1413e77-9983-4efa-adab-d4624858243d req-9248cff9-0ca8-4037-b376-e92350b82182 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d1413e77-9983-4efa-adab-d4624858243d req-9248cff9-0ca8-4037-b376-e92350b82182 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d1413e77-9983-4efa-adab-d4624858243d req-9248cff9-0ca8-4037-b376-e92350b82182 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-d1413e77-9983-4efa-adab-d4624858243d req-9248cff9-0ca8-4037-b376-e92350b82182 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:39:55 user nova-compute[75026]: WARNING nova.compute.manager [req-d1413e77-9983-4efa-adab-d4624858243d req-9248cff9-0ca8-4037-b376-e92350b82182 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state building and task_state spawning.
Nov 10 19:39:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-dc8409e5-79ff-409e-b9e3-c6ad9f22a5eb req-2ab09955-f2e1-4efe-850d-96d0d20ff3cb service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dc8409e5-79ff-409e-b9e3-c6ad9f22a5eb req-2ab09955-f2e1-4efe-850d-96d0d20ff3cb service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dc8409e5-79ff-409e-b9e3-c6ad9f22a5eb req-2ab09955-f2e1-4efe-850d-96d0d20ff3cb service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-dc8409e5-79ff-409e-b9e3-c6ad9f22a5eb req-2ab09955-f2e1-4efe-850d-96d0d20ff3cb service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-dc8409e5-79ff-409e-b9e3-c6ad9f22a5eb req-2ab09955-f2e1-4efe-850d-96d0d20ff3cb service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:39:57 user nova-compute[75026]: WARNING nova.compute.manager [req-dc8409e5-79ff-409e-b9e3-c6ad9f22a5eb req-2ab09955-f2e1-4efe-850d-96d0d20ff3cb service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state building and task_state spawning.
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:39:57 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance spawned successfully.
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:39:57 user nova-compute[75026]: INFO nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 10 19:39:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:39:57 user nova-compute[75026]: INFO nova.compute.manager [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Took 70.91 seconds to build instance.
Nov 10 19:39:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5198fa54-c11b-4091-9867-8547b56eb93c tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 71.050s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:39:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:39:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:40:02 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Creating image(s)
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Ensure instance console log exists: /opt/stack/data/nova/instances/8da60c29-7705-4267-acb1-4e32406a7699/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Start _get_guest_xml network_info=[{"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '09551730-e92c-48f1-b211-f6adea72d588', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCENowLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8da60c29-7705-4267-acb1-4e32406a7699', 'attached_at': '', 'detached_at': '', 'volume_id': '50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a', 'serial': '50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:40:02 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:40:02 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCENowLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:40:02 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:40:02 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:40:02 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eedfeeb-b1cd-4db7-b44d-a6a8d06db2d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:40:02 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e1f8ed-2180-4c27-9f4e-db6918b159ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a] added
Nov 10 19:40:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c063684-2d39-4171-8418-93f9ccf335b2]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd209d28-b2df-4ed5-8a5e-78ce8f72b02a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCENowLn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCENowLn" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af74111-335a-4bad-aac4-bdb4b90a7eff]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eCENowLn'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c722f146-29a7-4e7e-9def-8f224066cf48]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2932c056-3bf4-4606-9e8a-720a9a33ccd9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[358e4270-3885-4467-887d-0deba3f9ce08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a, portal: 172.16.0.220,3260]
Nov 10 19:40:02 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a, portal: 172.16.0.220,3260] successful.
Nov 10 19:40:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[647e1be4-89ef-4510-9dc4-9a704097e349]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b9a22b-9d56-4930-bf1a-e1a5bb1ed8a6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)
Nov 10 19:40:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:40:02 user nova-compute[75026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)
Nov 10 19:40:02 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c45408-4603-436f-878e-7a1e69796dab]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:40:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCENowLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23264326136663332', 'path': '/dev/sdd'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264326136663332', 'path': '/dev/sdd'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1214403026',display_name='tempest-TestVolumeBootPattern-server-1214403026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1214403026',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-mxihyn6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:39:25Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=8da60c29-7705-4267-acb1-4e32406a7699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=714e860e-5d76-421e-8c1f-468608d41c0c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e860e-5d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.objects.instance [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'pci_devices' on Instance uuid 8da60c29-7705-4267-acb1-4e32406a7699 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:40:03 user nova-compute[75026]:   <uuid>8da60c29-7705-4267-acb1-4e32406a7699</uuid>
Nov 10 19:40:03 user nova-compute[75026]:   <name>instance-00000027</name>
Nov 10 19:40:03 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:40:03 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:40:03 user nova-compute[75026]:   <metadata>
Nov 10 19:40:03 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:40:03 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:40:03 user nova-compute[75026]:       <nova:name>tempest-TestVolumeBootPattern-server-1214403026</nova:name>
Nov 10 19:40:03 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:40:02</nova:creationTime>
Nov 10 19:40:03 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:40:03 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:40:03 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:40:03 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:40:03 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:40:03 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:40:03 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:40:03 user nova-compute[75026]:       <nova:owner>
Nov 10 19:40:03 user nova-compute[75026]:         <nova:user uuid="758478b59f94467898696fa7af7cd630">tempest-TestVolumeBootPattern-1182723443-project-member</nova:user>
Nov 10 19:40:03 user nova-compute[75026]:         <nova:project uuid="e509e662d27146fba4f51fd55dbe6f83">tempest-TestVolumeBootPattern-1182723443</nova:project>
Nov 10 19:40:03 user nova-compute[75026]:       </nova:owner>
Nov 10 19:40:03 user nova-compute[75026]:       <nova:ports>
Nov 10 19:40:03 user nova-compute[75026]:         <nova:port uuid="714e860e-5d76-421e-8c1f-468608d41c0c">
Nov 10 19:40:03 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 19:40:03 user nova-compute[75026]:         </nova:port>
Nov 10 19:40:03 user nova-compute[75026]:       </nova:ports>
Nov 10 19:40:03 user nova-compute[75026]:     </nova:instance>
Nov 10 19:40:03 user nova-compute[75026]:   </metadata>
Nov 10 19:40:03 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:40:03 user nova-compute[75026]:     <system>
Nov 10 19:40:03 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:40:03 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:40:03 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:40:03 user nova-compute[75026]:       <entry name="serial">8da60c29-7705-4267-acb1-4e32406a7699</entry>
Nov 10 19:40:03 user nova-compute[75026]:       <entry name="uuid">8da60c29-7705-4267-acb1-4e32406a7699</entry>
Nov 10 19:40:03 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:40:03 user nova-compute[75026]:     </system>
Nov 10 19:40:03 user nova-compute[75026]:   </sysinfo>
Nov 10 19:40:03 user nova-compute[75026]:   <os>
Nov 10 19:40:03 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:40:03 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:40:03 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:40:03 user nova-compute[75026]:   </os>
Nov 10 19:40:03 user nova-compute[75026]:   <features>
Nov 10 19:40:03 user nova-compute[75026]:     <acpi/>
Nov 10 19:40:03 user nova-compute[75026]:     <apic/>
Nov 10 19:40:03 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:40:03 user nova-compute[75026]:   </features>
Nov 10 19:40:03 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:40:03 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:40:03 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:40:03 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:40:03 user nova-compute[75026]:   </clock>
Nov 10 19:40:03 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:40:03 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:40:03 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:40:03 user nova-compute[75026]:   </cpu>
Nov 10 19:40:03 user nova-compute[75026]:   <devices>
Nov 10 19:40:03 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:40:03 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:40:03 user nova-compute[75026]:       <source dev="/dev/sdd"/>
Nov 10 19:40:03 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:40:03 user nova-compute[75026]:       <serial>50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a</serial>
Nov 10 19:40:03 user nova-compute[75026]:     </disk>
Nov 10 19:40:03 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:40:03 user nova-compute[75026]:       <mac address="fa:16:3e:f7:e8:23"/>
Nov 10 19:40:03 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:40:03 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:40:03 user nova-compute[75026]:       <target dev="tap714e860e-5d"/>
Nov 10 19:40:03 user nova-compute[75026]:     </interface>
Nov 10 19:40:03 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:40:03 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/8da60c29-7705-4267-acb1-4e32406a7699/console.log" append="off"/>
Nov 10 19:40:03 user nova-compute[75026]:     </serial>
Nov 10 19:40:03 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:40:03 user nova-compute[75026]:     <video>
Nov 10 19:40:03 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:40:03 user nova-compute[75026]:     </video>
Nov 10 19:40:03 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:40:03 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:40:03 user nova-compute[75026]:     </rng>
Nov 10 19:40:03 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:40:03 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:40:03 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:40:03 user nova-compute[75026]:     </memballoon>
Nov 10 19:40:03 user nova-compute[75026]:   </devices>
Nov 10 19:40:03 user nova-compute[75026]: </domain>
Nov 10 19:40:03 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1214403026',display_name='tempest-TestVolumeBootPattern-server-1214403026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1214403026',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-mxihyn6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:39:25Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=8da60c29-7705-4267-acb1-4e32406a7699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=714e860e-5d76-421e-8c1f-468608d41c0c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e860e-5d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG os_vif [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=714e860e-5d76-421e-8c1f-468608d41c0c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e860e-5d') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae334281-3af0-5458-a241-5982a8832ae5', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap714e860e-5d, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap714e860e-5d, col_values=(('qos', UUID('499fda88-c06e-4a0c-b91e-3c682446c46e')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap714e860e-5d, col_values=(('external_ids', {'iface-id': '714e860e-5d76-421e-8c1f-468608d41c0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:e8:23', 'vm-uuid': '8da60c29-7705-4267-acb1-4e32406a7699'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:40:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:40:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:04 user nova-compute[75026]: INFO os_vif [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=714e860e-5d76-421e-8c1f-468608d41c0c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e860e-5d')
Nov 10 19:40:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:40:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] No VIF found with MAC fa:16:3e:f7:e8:23, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:40:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-1b696030-ca39-4582-98c3-0e8a2368b4ae req-610187d4-66f7-4a37-a070-9431743378ee service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b696030-ca39-4582-98c3-0e8a2368b4ae req-610187d4-66f7-4a37-a070-9431743378ee service nova] Acquiring lock "8da60c29-7705-4267-acb1-4e32406a7699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b696030-ca39-4582-98c3-0e8a2368b4ae req-610187d4-66f7-4a37-a070-9431743378ee service nova] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b696030-ca39-4582-98c3-0e8a2368b4ae req-610187d4-66f7-4a37-a070-9431743378ee service nova] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:40:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-1b696030-ca39-4582-98c3-0e8a2368b4ae req-610187d4-66f7-4a37-a070-9431743378ee service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] No waiting events found dispatching network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:40:05 user nova-compute[75026]: WARNING nova.compute.manager [req-1b696030-ca39-4582-98c3-0e8a2368b4ae req-610187d4-66f7-4a37-a070-9431743378ee service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received unexpected event network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c for instance with vm_state building and task_state spawning.
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:40:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Instance spawned successfully.
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:40:07 user nova-compute[75026]: INFO nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-9cfbde4c-c6bb-474b-8c8d-60b8dd0c34d0 req-ff53c40c-8fb7-4dfa-8470-2f32f214c1e2 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9cfbde4c-c6bb-474b-8c8d-60b8dd0c34d0 req-ff53c40c-8fb7-4dfa-8470-2f32f214c1e2 service nova] Acquiring lock "8da60c29-7705-4267-acb1-4e32406a7699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9cfbde4c-c6bb-474b-8c8d-60b8dd0c34d0 req-ff53c40c-8fb7-4dfa-8470-2f32f214c1e2 service nova] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9cfbde4c-c6bb-474b-8c8d-60b8dd0c34d0 req-ff53c40c-8fb7-4dfa-8470-2f32f214c1e2 service nova] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:40:07 user nova-compute[75026]: DEBUG nova.compute.manager [req-9cfbde4c-c6bb-474b-8c8d-60b8dd0c34d0 req-ff53c40c-8fb7-4dfa-8470-2f32f214c1e2 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] No waiting events found dispatching network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:40:07 user nova-compute[75026]: WARNING nova.compute.manager [req-9cfbde4c-c6bb-474b-8c8d-60b8dd0c34d0 req-ff53c40c-8fb7-4dfa-8470-2f32f214c1e2 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received unexpected event network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c for instance with vm_state building and task_state spawning.
Nov 10 19:40:08 user nova-compute[75026]: INFO nova.compute.manager [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Took 43.51 seconds to build instance.
Nov 10 19:40:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-be7189e9-465a-4eb9-b211-d2a93308e5dd tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8da60c29-7705-4267-acb1-4e32406a7699" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.687s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:40:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:19 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:40:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:40:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:40:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:40:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:40:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=25.21883773803711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b6734c90-d9b3-4705-bb7f-5c5df66e0baf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 8da60c29-7705-4267-acb1-4e32406a7699 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:40:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:40:28 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:28 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:28 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:40:28 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:40:28 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:28 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:40:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:40:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-e09c7566-4a27-4d7b-8194-9f6ee1e728f4 req-d581e4b3-f129-43d8-873f-a085684b4913 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received event network-changed-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:40:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-e09c7566-4a27-4d7b-8194-9f6ee1e728f4 req-d581e4b3-f129-43d8-873f-a085684b4913 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Refreshing instance network info cache due to event network-changed-9d44a002-8ee9-4be7-b437-cf08ff9119d7. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:40:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e09c7566-4a27-4d7b-8194-9f6ee1e728f4 req-d581e4b3-f129-43d8-873f-a085684b4913 service nova] Acquiring lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:40:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e09c7566-4a27-4d7b-8194-9f6ee1e728f4 req-d581e4b3-f129-43d8-873f-a085684b4913 service nova] Acquired lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:40:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-e09c7566-4a27-4d7b-8194-9f6ee1e728f4 req-d581e4b3-f129-43d8-873f-a085684b4913 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Refreshing network info cache for port 9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:40:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-e09c7566-4a27-4d7b-8194-9f6ee1e728f4 req-d581e4b3-f129-43d8-873f-a085684b4913 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Updated VIF entry in instance network info cache for port 9d44a002-8ee9-4be7-b437-cf08ff9119d7. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:40:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-e09c7566-4a27-4d7b-8194-9f6ee1e728f4 req-d581e4b3-f129-43d8-873f-a085684b4913 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Updating instance_info_cache with network_info: [{"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:40:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e09c7566-4a27-4d7b-8194-9f6ee1e728f4 req-d581e4b3-f129-43d8-873f-a085684b4913 service nova] Releasing lock "refresh_cache-e16d4fd8-931a-43b2-aca8-45b6c2b571a3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lazy-loading 'flavor' on Instance uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:40:31 user nova-compute[75026]: INFO nova.compute.manager [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Attaching volume 9ba2222b-7b87-4c11-82d5-ae4feffb7a1c to /dev/vdb
Nov 10 19:40:31 user nova-compute[75026]: DEBUG os_brick.utils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9124dd4-6ffc-46ed-914f-0c58ab507199]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaccb76-7ef7-43f9-8216-3d48e7763150]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5919fd44-f0f9-4512-9195-65921208ae9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5cd55-d55a-4c9a-9592-bfcdc03215cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:40:31 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:40:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f443bf35-12fb-42ea-858e-1b5122495da6]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG os_brick.utils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:40:31 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Updating existing volume attachment record: e1324c1c-0726-4a15-87ab-f5aa3ebeaa0e {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:40:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:40:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:40:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:40:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:40:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxtDPMrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:40:56 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:40:56 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:40:56 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ddea8-d44f-4734-8b73-8d5ce9728626]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:40:56 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2d9b68-5792-46b5-93b8-906cc641f3f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c] added
Nov 10 19:40:56 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[226428d5-064d-4b91-b221-6dca31b29b60]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21441cc-d210-452a-aced-52223f1cce80]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxtDPMrv {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxtDPMrv" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee32f03-5332-4d26-a0b6-13cde8f5faad]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yxtDPMrv'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4576a45-d808-4e8e-8548-dd2e06416ca9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce70b95-f421-4b65-a9b8-05529836ecac]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)
Nov 10 19:40:57 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)
Nov 10 19:40:57 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b20c884-dcc9-4e97-8577-a4399023fa97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c, portal: 172.16.0.220,3260]
Nov 10 19:40:57 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c, portal: 172.16.0.220,3260] successful.
Nov 10 19:40:57 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8c5a5-5fde-420a-a568-1f01100654dd]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f492975-cfaa-435b-815f-ff9dc99372c2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:40:57 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)
Nov 10 19:40:57 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:40:57 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a6f8d2-0f13-44c5-8701-675c64fe33e3]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:40:57 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxtDPMrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23238616532373563', 'path': '/dev/sdf'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238616532373563', 'path': '/dev/sdf'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lazy-loading 'flavor' on Instance uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:40:58 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:40:58 user nova-compute[75026]:   <source dev="/dev/sdf"/>
Nov 10 19:40:58 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:40:58 user nova-compute[75026]:   <serial>9ba2222b-7b87-4c11-82d5-ae4feffb7a1c</serial>
Nov 10 19:40:58 user nova-compute[75026]: </disk>
Nov 10 19:40:58 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No VIF found with MAC fa:16:3e:d2:2e:9f, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:40:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d966639c-d392-40cd-aaf9-36415a95fb2a tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.433s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:40:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:40:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:40:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:40:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:40:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:40:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:01 user nova-compute[75026]: DEBUG nova.objects.instance [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lazy-loading 'flavor' on Instance uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:01 user nova-compute[75026]: INFO nova.compute.manager [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Attaching volume ffa73d45-dba8-4769-918d-3bd76feceefb to /dev/vdc
Nov 10 19:41:01 user nova-compute[75026]: DEBUG os_brick.utils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:41:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[91289db1-1ceb-407b-903d-2b0debdfa3be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d280f9-575b-4ee7-b590-e1edb25aa8d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f144840b-6df1-4550-af14-4e3710af8e59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e926a274-c9df-4a41-98ef-71c91b357779]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:41:02 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:41:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f35cb32-2726-4390-9e0d-a5349a78a5c5]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG os_brick.utils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:41:02 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Updating existing volume attachment record: d5e45f5f-44f8-4937-a999-8ee3ada77aee {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:41:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:41:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:41:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:04 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:41:04 user nova-compute[75026]: INFO nova.compute.claims [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Claim successful on node user
Nov 10 19:41:05 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG nova.network.neutron [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:41:05 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:41:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG nova.policy [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4fcc097fff34ad2b2cc532d269e06bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdef98b8144148229b82888b888d88c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:41:05 user nova-compute[75026]: INFO nova.virt.block_device [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Booting with volume 4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee at /dev/vda
Nov 10 19:41:05 user nova-compute[75026]: DEBUG os_brick.utils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b205f8f-f587-4a95-98b9-482dd977046e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa7f420-ebe7-4f6f-95e6-90db1e04b68b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42c270-f392-48a8-814d-e382fe18d327]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dae7cee-6c5a-4ffd-99a4-4ea6f1038116]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:41:05 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:41:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7e20b2-8d11-46db-8cbd-da1c8353c288]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG os_brick.utils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:41:05 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating existing volume attachment record: 699b2781-794a-41e6-96fb-c890913dd5aa {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Successfully created port: fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Successfully updated port: fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquired lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG nova.network.neutron [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-0143c883-a938-4c98-ad8a-86b2a2ce2408 req-b0d1e2e8-9f08-460a-9d6f-682da3dc6ee5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-changed-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG nova.compute.manager [req-0143c883-a938-4c98-ad8a-86b2a2ce2408 req-b0d1e2e8-9f08-460a-9d6f-682da3dc6ee5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Refreshing instance network info cache due to event network-changed-fc91a2c1-39c8-48ff-bb26-046aa507a18e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:41:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0143c883-a938-4c98-ad8a-86b2a2ce2408 req-b0d1e2e8-9f08-460a-9d6f-682da3dc6ee5 service nova] Acquiring lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:41:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:41:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating instance_info_cache with network_info: [{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:41:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Releasing lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:41:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance network_info: |[{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:41:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0143c883-a938-4c98-ad8a-86b2a2ce2408 req-b0d1e2e8-9f08-460a-9d6f-682da3dc6ee5 service nova] Acquired lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:41:07 user nova-compute[75026]: DEBUG nova.network.neutron [req-0143c883-a938-4c98-ad8a-86b2a2ce2408 req-b0d1e2e8-9f08-460a-9d6f-682da3dc6ee5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Refreshing network info cache for port fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:41:08 user nova-compute[75026]: DEBUG nova.network.neutron [req-0143c883-a938-4c98-ad8a-86b2a2ce2408 req-b0d1e2e8-9f08-460a-9d6f-682da3dc6ee5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updated VIF entry in instance network info cache for port fc91a2c1-39c8-48ff-bb26-046aa507a18e. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:41:08 user nova-compute[75026]: DEBUG nova.network.neutron [req-0143c883-a938-4c98-ad8a-86b2a2ce2408 req-b0d1e2e8-9f08-460a-9d6f-682da3dc6ee5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating instance_info_cache with network_info: [{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:41:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0143c883-a938-4c98-ad8a-86b2a2ce2408 req-b0d1e2e8-9f08-460a-9d6f-682da3dc6ee5 service nova] Releasing lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:41:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:41:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:41:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:41:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:41:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-a915c758-d5ae-49d0-ae59-f015d81f83db req-815c9fb4-5f9e-402f-bd09-91c7d72d2097 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-changed-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-a915c758-d5ae-49d0-ae59-f015d81f83db req-815c9fb4-5f9e-402f-bd09-91c7d72d2097 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Refreshing instance network info cache due to event network-changed-714e860e-5d76-421e-8c1f-468608d41c0c. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:41:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a915c758-d5ae-49d0-ae59-f015d81f83db req-815c9fb4-5f9e-402f-bd09-91c7d72d2097 service nova] Acquiring lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:41:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a915c758-d5ae-49d0-ae59-f015d81f83db req-815c9fb4-5f9e-402f-bd09-91c7d72d2097 service nova] Acquired lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:41:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-a915c758-d5ae-49d0-ae59-f015d81f83db req-815c9fb4-5f9e-402f-bd09-91c7d72d2097 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Refreshing network info cache for port 714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-a915c758-d5ae-49d0-ae59-f015d81f83db req-815c9fb4-5f9e-402f-bd09-91c7d72d2097 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updated VIF entry in instance network info cache for port 714e860e-5d76-421e-8c1f-468608d41c0c. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-a915c758-d5ae-49d0-ae59-f015d81f83db req-815c9fb4-5f9e-402f-bd09-91c7d72d2097 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updating instance_info_cache with network_info: [{"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a915c758-d5ae-49d0-ae59-f015d81f83db req-815c9fb4-5f9e-402f-bd09-91c7d72d2097 service nova] Releasing lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "8da60c29-7705-4267-acb1-4e32406a7699" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8da60c29-7705-4267-acb1-4e32406a7699" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "8da60c29-7705-4267-acb1-4e32406a7699-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:16 user nova-compute[75026]: INFO nova.compute.manager [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Terminating instance
Nov 10 19:41:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Instance destroyed successfully.
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'resources' on Instance uuid 8da60c29-7705-4267-acb1-4e32406a7699 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1214403026',display_name='tempest-TestVolumeBootPattern-server-1214403026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1214403026',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:40:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-mxihyn6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:40:08Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=8da60c29-7705-4267-acb1-4e32406a7699,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=714e860e-5d76-421e-8c1f-468608d41c0c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e860e-5d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_vif [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=714e860e-5d76-421e-8c1f-468608d41c0c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e860e-5d') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap714e860e-5d, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=499fda88-c06e-4a0c-b91e-3c682446c46e) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:17 user nova-compute[75026]: INFO os_vif [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:e8:23,bridge_name='br-int',has_traffic_filtering=True,id=714e860e-5d76-421e-8c1f-468608d41c0c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e860e-5d')
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCENowLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:41:17 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7451e1ff-37c2-4856-af31-92564018ff2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:41:17 user nova-compute[75026]: No targets found.
Nov 10 19:41:17 user nova-compute[75026]: iSNS:
Nov 10 19:41:17 user nova-compute[75026]: No targets found.
Nov 10 19:41:17 user nova-compute[75026]: STATIC:
Nov 10 19:41:17 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a
Nov 10 19:41:17 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:41:17 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:41:17 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c
Nov 10 19:41:17 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:41:17 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:41:17 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0
Nov 10 19:41:17 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:41:17 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:41:17 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:41:17 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:41:17 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:41:17 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:41:17 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:41:17 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:41:17 user nova-compute[75026]: FIRMWARE:
Nov 10 19:41:17 user nova-compute[75026]: No targets found.
Nov 10 19:41:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:41:17 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:41:17 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb840c4-9bc2-4a32-9c0d-9f99272f0532]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[67683b7d-97ea-48fa-b0e6-0cd797962115]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:41:17 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:41:17 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:41:17 user nova-compute[75026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)
Nov 10 19:41:17 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:41:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:41:17 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:41:17 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:41:17 user nova-compute[75026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a (non-flash)
Nov 10 19:41:17 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:41:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed8011c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a'): ({'sdd'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Removing single pathed devices sdd {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8814c1e2-cc78-43bf-a3a5-31d68b985e53]: (4, ('path checker states:\nup                  3\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[500f6892-07dd-4ca4-8ad4-3a1053ecd8c7]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flushing IO for device /dev/sdd {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40c41b8-acff-46ee-a2b6-fe40c27d871a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.070s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7169a8-7e59-4506-938b-7e193aa074d6]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf9b321-948e-48d7-bec5-3cd39d0fa06f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-changed-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Refreshing instance network info cache due to event network-changed-714e860e-5d76-421e-8c1f-468608d41c0c. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Acquiring lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Acquired lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.network.neutron [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Refreshing network info cache for port 714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc82277-e25a-4132-b4bb-d0c870856f6c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a, portal: 172.16.0.220,3260]
Nov 10 19:41:17 user nova-compute[75026]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a, portal: 172.16.0.220,3260] successful.
Nov 10 19:41:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50cc6ea3-c3aa-43ef-ac64-4929cbb39e1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d30b195-b1de-4807-8e2a-631b7debb15d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== disconnect_volume: return (366ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:41:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:41:17 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Deleting instance files /opt/stack/data/nova/instances/8da60c29-7705-4267-acb1-4e32406a7699_del
Nov 10 19:41:17 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Deletion of /opt/stack/data/nova/instances/8da60c29-7705-4267-acb1-4e32406a7699_del complete
Nov 10 19:41:18 user nova-compute[75026]: INFO nova.compute.manager [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 10 19:41:18 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.network.neutron [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updated VIF entry in instance network info cache for port 714e860e-5d76-421e-8c1f-468608d41c0c. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.network.neutron [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updating instance_info_cache with network_info: [{"id": "714e860e-5d76-421e-8c1f-468608d41c0c", "address": "fa:16:3e:f7:e8:23", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e860e-5d", "ovs_interfaceid": "714e860e-5d76-421e-8c1f-468608d41c0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Releasing lock "refresh_cache-8da60c29-7705-4267-acb1-4e32406a7699" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-vif-unplugged-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Acquiring lock "8da60c29-7705-4267-acb1-4e32406a7699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] No waiting events found dispatching network-vif-unplugged-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-vif-unplugged-714e860e-5d76-421e-8c1f-468608d41c0c for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Acquiring lock "8da60c29-7705-4267-acb1-4e32406a7699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] Lock "8da60c29-7705-4267-acb1-4e32406a7699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] No waiting events found dispatching network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:18 user nova-compute[75026]: WARNING nova.compute.manager [req-82abc99d-b872-4639-9bfb-89f9da73699d req-1727512d-44ff-484c-87d2-8c3cc91f65d5 service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received unexpected event network-vif-plugged-714e860e-5d76-421e-8c1f-468608d41c0c for instance with vm_state active and task_state deleting.
Nov 10 19:41:18 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:41:18 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Took 0.88 seconds to deallocate network for instance.
Nov 10 19:41:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-36364851-498d-4bf6-93e9-f66d8cc92dc8 req-ec2b93d0-af35-412d-ba8f-2dc2c733c48f service nova] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Received event network-vif-deleted-714e860e-5d76-421e-8c1f-468608d41c0c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:19 user nova-compute[75026]: INFO nova.compute.manager [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 8da60c29-7705-4267-acb1-4e32406a7699] Took 0.98 seconds to detach 1 volumes for instance.
Nov 10 19:41:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:20 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:41:20 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:41:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:20 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Deleted allocations for instance 8da60c29-7705-4267-acb1-4e32406a7699
Nov 10 19:41:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4f561a72-5d1a-4449-9495-088e3cecd6da tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "8da60c29-7705-4267-acb1-4e32406a7699" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.701s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:21 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:41:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:41:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=25.215423583984375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b6734c90-d9b3-4705-bb7f-5c5df66e0baf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5bf6de24-c6a5-4b68-ad60-7f582463016b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:41:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:41:28 user nova-compute[75026]: INFO nova.compute.manager [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Rescuing
Nov 10 19:41:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:41:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquired lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:41:28 user nova-compute[75026]: DEBUG nova.network.neutron [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:41:28 user nova-compute[75026]: DEBUG nova.network.neutron [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Updating instance_info_cache with network_info: [{"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:41:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Releasing lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:41:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-53df1e35-efc6-4c19-b00d-11b63de000eb req-86151d01-f6d0-4e1e-aa83-c5b8a088f355 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-53df1e35-efc6-4c19-b00d-11b63de000eb req-86151d01-f6d0-4e1e-aa83-c5b8a088f355 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-53df1e35-efc6-4c19-b00d-11b63de000eb req-86151d01-f6d0-4e1e-aa83-c5b8a088f355 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-53df1e35-efc6-4c19-b00d-11b63de000eb req-86151d01-f6d0-4e1e-aa83-c5b8a088f355 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-53df1e35-efc6-4c19-b00d-11b63de000eb req-86151d01-f6d0-4e1e-aa83-c5b8a088f355 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:29 user nova-compute[75026]: WARNING nova.compute.manager [req-53df1e35-efc6-4c19-b00d-11b63de000eb req-86151d01-f6d0-4e1e-aa83-c5b8a088f355 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state rescuing.
Nov 10 19:41:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance destroyed successfully.
Nov 10 19:41:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Attempting a stable device rescue
Nov 10 19:41:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance directory exists: not creating {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 19:41:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Creating image(s)
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "/opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "/opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG nova.objects.instance [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'trusted_certs' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:41:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Skipping network cache update for instance because it is Building. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid b9e39b1a-3119-456e-b16d-192dbcd66ae3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG nova.virt.images [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] d96d6162-801e-497b-a0f3-10e2b870d311 was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:41:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3.part /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:31 user nova-compute[75026]: WARNING nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state rescuing.
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:31 user nova-compute[75026]: WARNING nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state rescuing.
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:31 user nova-compute[75026]: WARNING nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state rescuing.
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:31 user nova-compute[75026]: WARNING nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state rescuing.
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:31 user nova-compute[75026]: WARNING nova.compute.manager [req-9094032f-6bd8-4b0d-b707-1b1fb1fc50ee req-fb008a46-d42b-4d16-b9fc-93e7e5145757 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state rescuing.
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updating instance_info_cache with network_info: [{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3.part /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3.converted" returned: 0 in 0.703s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.159s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3 --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3,backing_fmt=raw /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.rescue {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3,backing_fmt=raw /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.rescue" returned: 0 in 0.049s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.instance [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'migration_context' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<b6734c90-d9b3-4705-bb7f-5c5df66e0baf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Start _get_guest_xml network_info=[{"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "vif_mac": "fa:16:3e:c8:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd96d6162-801e-497b-a0f3-10e2b870d311', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ab702487-e491-4e8a-9892-e8882e0cf32f', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpjVgYPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b6734c90-d9b3-4705-bb7f-5c5df66e0baf', 'attached_at': '', 'detached_at': '', 'volume_id': '2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'serial': '2d1f6d1d-e407-44d4-ad38-b1de9f8845a6'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.instance [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'resources' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<b6734c90-d9b3-4705-bb7f-5c5df66e0baf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.instance [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'numa_topology' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<b6734c90-d9b3-4705-bb7f-5c5df66e0baf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:41:32 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:41:32 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.instance [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'vcpu_model' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<b6734c90-d9b3-4705-bb7f-5c5df66e0baf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpjVgYPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:41:32 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:41:32 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:41:32 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b4fe32-e96c-41ee-ae66-e72433e3afbb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wpjVgYPU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 19:41:32 user nova-compute[75026]: node.name = iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:41:32 user nova-compute[75026]: node.tpgt = -1
Nov 10 19:41:32 user nova-compute[75026]: node.startup = automatic
Nov 10 19:41:32 user nova-compute[75026]: node.leading_login = No
Nov 10 19:41:32 user nova-compute[75026]: iface.iscsi_ifacename = default
Nov 10 19:41:32 user nova-compute[75026]: iface.net_ifacename = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.ipaddress = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.prefix_len = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.hwaddress = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.transport_name = tcp
Nov 10 19:41:32 user nova-compute[75026]: iface.initiatorname = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.state = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.vlan_id = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.vlan_priority = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.vlan_state = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.iface_num = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.mtu = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.port = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.bootproto = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.subnet_mask = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.gateway = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.dhcp_alt_client_id = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.dhcp_dns = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.dhcp_learn_iqn = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.dhcp_vendor_id_state = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.dhcp_vendor_id = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.dhcp_slp_da = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.fragmentation = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.gratuitous_arp = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.incoming_forwarding = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.tos_state = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.tos = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.ttl = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.delayed_ack = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.tcp_nagle = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.tcp_wsf_state = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.tcp_wsf = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.tcp_timer_scale = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.tcp_timestamp = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.redirect = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.def_task_mgmt_timeout = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.header_digest = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.data_digest = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.immediate_data = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.initial_r2t = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.data_seq_inorder = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.data_pdu_inorder = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.erl = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.max_receive_data_len = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.first_burst_len = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.max_outstanding_r2t = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.max_burst_len = 0
Nov 10 19:41:32 user nova-compute[75026]: iface.chap_auth = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.bidi_chap = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.strict_login_compliance = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.discovery_auth = <empty>
Nov 10 19:41:32 user nova-compute[75026]: iface.discovery_logout = <empty>
Nov 10 19:41:32 user nova-compute[75026]: node.discovery_address = <empty>
Nov 10 19:41:32 user nova-compute[75026]: node.discovery_port = 0
Nov 10 19:41:32 user nova-compute[75026]: node.discovery_type = static
Nov 10 19:41:32 user nova-compute[75026]: node.session.initial_cmdsn = 0
Nov 10 19:41:32 user nova-compute[75026]: node.session.initial_login_retry_max = 8
Nov 10 19:41:32 user nova-compute[75026]: node.session.xmit_thread_priority = -20
Nov 10 19:41:32 user nova-compute[75026]: node.session.cmds_max = 128
Nov 10 19:41:32 user nova-compute[75026]: node.session.queue_depth = 32
Nov 10 19:41:32 user nova-compute[75026]: node.session.nr_sessions = 1
Nov 10 19:41:32 user nova-compute[75026]: node.session.auth.authmethod = CHAP
Nov 10 19:41:32 user nova-compute[75026]: node.session.auth.username = wpjVgYPU
Nov 10 19:41:32 user nova-compute[75026]: node.session.auth.password = ***
Nov 10 19:41:32 user nova-compute[75026]: node.session.auth.username_in = <empty>
Nov 10 19:41:32 user nova-compute[75026]: node.session.auth.password_in = <empty>
Nov 10 19:41:32 user nova-compute[75026]: node.session.auth.chap_algs = MD5
Nov 10 19:41:32 user nova-compute[75026]: node.session.timeo.replacement_timeout = 120
Nov 10 19:41:32 user nova-compute[75026]: node.session.err_timeo.abort_timeout = 15
Nov 10 19:41:32 user nova-compute[75026]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 19:41:32 user nova-compute[75026]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 19:41:32 user nova-compute[75026]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.FastAbort = Yes
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.InitialR2T = No
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.ImmediateData = Yes
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.MaxConnections = 1
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 19:41:32 user nova-compute[75026]: node.session.iscsi.ERL = 0
Nov 10 19:41:32 user nova-compute[75026]: node.session.scan = manual
Nov 10 19:41:32 user nova-compute[75026]: node.session.reopen_max = 0
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].address = 172.16.0.220
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].port = 3260
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].startup = manual
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].tcp.window_size = 524288
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].tcp.type_of_service = 0
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].timeo.logout_timeout = 15
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].timeo.login_timeout = 15
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].timeo.auth_timeout = 45
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].iscsi.DataDigest = None
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].iscsi.IFMarker = No
Nov 10 19:41:32 user nova-compute[75026]: node.conn[0].iscsi.OFMarker = No
Nov 10 19:41:32 user nova-compute[75026]: # END RECORD
Nov 10 19:41:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[753161b6-e48f-410d-b9d0-539d4a91dadd]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1101525e-8f93-447a-a833-29f61825d595]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpjVgYPU {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpjVgYPU" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2320c8e5-ffbe-4744-be64-a3dbfff1548d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wpjVgYPU'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac90f9e0-02b7-4dca-ac16-da7bf7b951e5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd016be6-7f66-4873-8148-c345865672e1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:41:32 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:41:32 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:41:32 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:41:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:41:32 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:41:32 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:41:32 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:41:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] HCTL ('34', '0', '0', 0) found on session 35 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a2b3c6-b534-4268-bf40-21ab1bee1ab4]: (4, ('0 0 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Searching for a device in session 35 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpjVgYPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '23361316538653039', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361316538653039', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-591311641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-591311641',id=37,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:39:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-d4fcplpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:39:58Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=b6734c90-d9b3-4705-bb7f-5c5df66e0baf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "vif_mac": "fa:16:3e:c8:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "vif_mac": "fa:16:3e:c8:79:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=38091bf6-30e8-4cb1-8aa6-ccf0d388b584,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38091bf6-30') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.instance [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'pci_devices' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.objects.base [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Object Instance<b6734c90-d9b3-4705-bb7f-5c5df66e0baf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:41:32 user nova-compute[75026]:   <uuid>b6734c90-d9b3-4705-bb7f-5c5df66e0baf</uuid>
Nov 10 19:41:32 user nova-compute[75026]:   <name>instance-00000025</name>
Nov 10 19:41:32 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:41:32 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:41:32 user nova-compute[75026]:   <metadata>
Nov 10 19:41:32 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:41:32 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:41:32 user nova-compute[75026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-591311641</nova:name>
Nov 10 19:41:32 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:41:32</nova:creationTime>
Nov 10 19:41:32 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:41:32 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:41:32 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:41:32 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:41:32 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:41:32 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:41:32 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:41:32 user nova-compute[75026]:       <nova:owner>
Nov 10 19:41:32 user nova-compute[75026]:         <nova:user uuid="fcbd2be26ec84b5d9f6f6638963e870e">tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member</nova:user>
Nov 10 19:41:32 user nova-compute[75026]:         <nova:project uuid="43e468483e8f4f70bd228ff8194d76b7">tempest-ServerBootFromVolumeStableRescueTest-1118157225</nova:project>
Nov 10 19:41:32 user nova-compute[75026]:       </nova:owner>
Nov 10 19:41:32 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:41:32 user nova-compute[75026]:       <nova:ports>
Nov 10 19:41:32 user nova-compute[75026]:         <nova:port uuid="38091bf6-30e8-4cb1-8aa6-ccf0d388b584">
Nov 10 19:41:32 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 19:41:32 user nova-compute[75026]:         </nova:port>
Nov 10 19:41:32 user nova-compute[75026]:       </nova:ports>
Nov 10 19:41:32 user nova-compute[75026]:     </nova:instance>
Nov 10 19:41:32 user nova-compute[75026]:   </metadata>
Nov 10 19:41:32 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:41:32 user nova-compute[75026]:     <system>
Nov 10 19:41:32 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:41:32 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:41:32 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:41:32 user nova-compute[75026]:       <entry name="serial">b6734c90-d9b3-4705-bb7f-5c5df66e0baf</entry>
Nov 10 19:41:32 user nova-compute[75026]:       <entry name="uuid">b6734c90-d9b3-4705-bb7f-5c5df66e0baf</entry>
Nov 10 19:41:32 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:41:32 user nova-compute[75026]:     </system>
Nov 10 19:41:32 user nova-compute[75026]:   </sysinfo>
Nov 10 19:41:32 user nova-compute[75026]:   <os>
Nov 10 19:41:32 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:41:32 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:41:32 user nova-compute[75026]:   </os>
Nov 10 19:41:32 user nova-compute[75026]:   <features>
Nov 10 19:41:32 user nova-compute[75026]:     <acpi/>
Nov 10 19:41:32 user nova-compute[75026]:     <apic/>
Nov 10 19:41:32 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:41:32 user nova-compute[75026]:   </features>
Nov 10 19:41:32 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:41:32 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:41:32 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:41:32 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:41:32 user nova-compute[75026]:   </clock>
Nov 10 19:41:32 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:41:32 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:41:32 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:41:32 user nova-compute[75026]:   </cpu>
Nov 10 19:41:32 user nova-compute[75026]:   <devices>
Nov 10 19:41:32 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:41:32 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:41:32 user nova-compute[75026]:       <source dev="/dev/sdc"/>
Nov 10 19:41:32 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:41:32 user nova-compute[75026]:       <serial>2d1f6d1d-e407-44d4-ad38-b1de9f8845a6</serial>
Nov 10 19:41:32 user nova-compute[75026]:     </disk>
Nov 10 19:41:32 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:41:32 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:41:32 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.rescue"/>
Nov 10 19:41:32 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:41:32 user nova-compute[75026]:       <boot order="1"/>
Nov 10 19:41:32 user nova-compute[75026]:     </disk>
Nov 10 19:41:32 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:41:32 user nova-compute[75026]:       <mac address="fa:16:3e:c8:79:7e"/>
Nov 10 19:41:32 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:41:32 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:41:32 user nova-compute[75026]:       <target dev="tap38091bf6-30"/>
Nov 10 19:41:32 user nova-compute[75026]:     </interface>
Nov 10 19:41:32 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:41:32 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/console.log" append="off"/>
Nov 10 19:41:32 user nova-compute[75026]:     </serial>
Nov 10 19:41:32 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:41:32 user nova-compute[75026]:     <video>
Nov 10 19:41:32 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:41:32 user nova-compute[75026]:     </video>
Nov 10 19:41:32 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:41:32 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:41:32 user nova-compute[75026]:     </rng>
Nov 10 19:41:32 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:41:32 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:41:32 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:41:32 user nova-compute[75026]:     </memballoon>
Nov 10 19:41:32 user nova-compute[75026]:   </devices>
Nov 10 19:41:32 user nova-compute[75026]: </domain>
Nov 10 19:41:32 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:41:32 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance destroyed successfully.
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] No VIF found with MAC fa:16:3e:c8:79:7e, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:41:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-6c3c2822-30ff-40d1-8b02-22ff46f83895 req-b4aad298-b842-4091-b101-584268bef830 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6c3c2822-30ff-40d1-8b02-22ff46f83895 req-b4aad298-b842-4091-b101-584268bef830 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6c3c2822-30ff-40d1-8b02-22ff46f83895 req-b4aad298-b842-4091-b101-584268bef830 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6c3c2822-30ff-40d1-8b02-22ff46f83895 req-b4aad298-b842-4091-b101-584268bef830 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-6c3c2822-30ff-40d1-8b02-22ff46f83895 req-b4aad298-b842-4091-b101-584268bef830 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:34 user nova-compute[75026]: WARNING nova.compute.manager [req-6c3c2822-30ff-40d1-8b02-22ff46f83895 req-b4aad298-b842-4091-b101-584268bef830 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state rescuing.
Nov 10 19:41:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-6bc87343-a7d7-4b9f-965b-7ea697a01878 req-acb8c1a6-7d5e-4932-a8e4-f4d29fd18d62 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6bc87343-a7d7-4b9f-965b-7ea697a01878 req-acb8c1a6-7d5e-4932-a8e4-f4d29fd18d62 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6bc87343-a7d7-4b9f-965b-7ea697a01878 req-acb8c1a6-7d5e-4932-a8e4-f4d29fd18d62 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6bc87343-a7d7-4b9f-965b-7ea697a01878 req-acb8c1a6-7d5e-4932-a8e4-f4d29fd18d62 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-6bc87343-a7d7-4b9f-965b-7ea697a01878 req-acb8c1a6-7d5e-4932-a8e4-f4d29fd18d62 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:36 user nova-compute[75026]: WARNING nova.compute.manager [req-6bc87343-a7d7-4b9f-965b-7ea697a01878 req-acb8c1a6-7d5e-4932-a8e4-f4d29fd18d62 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state rescuing.
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.compute.manager [None req-13db1b69-7aaf-4166-883d-32af6d2ed7ae tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:41:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Creating image(s)
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Ensure instance console log exists: /opt/stack/data/nova/instances/5bf6de24-c6a5-4b68-ad60-7f582463016b/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Start _get_guest_xml network_info=[{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '699b2781-794a-41e6-96fb-c890913dd5aa', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWsJfgjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5bf6de24-c6a5-4b68-ad60-7f582463016b', 'attached_at': '', 'detached_at': '', 'volume_id': '4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'serial': '4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:41:36 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:41:36 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWsJfgjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:41:36 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:41:36 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:41:36 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a242efcd-fa55-47e4-b925-0058f78eaad1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:41:36 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[690b04f9-2e8d-4840-ad9a-b8133203a308]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee] added
Nov 10 19:41:36 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85e1c0a-7138-45b5-bd5a-b0014eb5758b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eb6686-a5c8-46c7-9b34-e0c2c29b8d98]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWsJfgjF {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWsJfgjF" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63afb0a-de78-41f6-ad49-963ec6644f67]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWsJfgjF'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6049121-067e-4202-acbe-70a6874be782]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4775d86-e787-4c76-a902-0f8981114369]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:41:36 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:41:36 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:41:36 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:41:36 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:41:36 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:41:36 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:41:36 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:41:36 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:41:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[78084fc0-c752-4f60-a098-65edaf9434a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260]
Nov 10 19:41:37 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260] successful.
Nov 10 19:41:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b412b2a-dc1c-431b-a0e3-ca60668d767b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78fcac0-6f21-4af9-8d3e-33f5aa16fd30]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:41:37 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:41:37 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:41:37 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:41:37 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:41:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:41:37 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:41:37 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:41:37 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:41:37 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:41:37 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3e2c90-983f-47c3-9d01-352cd1a91e8b]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'flavor' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:37 user nova-compute[75026]: INFO nova.compute.manager [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Attaching volume afc4a073-7103-465b-92df-ebe7d42ac1b4 to /dev/vdb
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.utils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c65f1e5-e2cc-4c0b-b161-24752e91b248]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54e2dda-728b-4b0b-ae2b-48a08b5f307c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddbc765-e2df-4f7e-be19-60ffea058d0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30c3101-dcf6-4da8-ac52-deeadaed7e22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:41:37 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:41:37 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce50cbf-fc4d-4a46-bdf9-22f8270eabb7]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_brick.utils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating existing volume attachment record: fa92cc25-f68b-4e07-b1af-86181193768e {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWsJfgjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26362346537313666', 'path': '/dev/sdd'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362346537313666', 'path': '/dev/sdd'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1250687212',display_name='tempest-ServerActionsTestOtherA-server-1250687212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1250687212',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-un001tri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=5bf6de24-c6a5-4b68-ad60-7f582463016b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.objects.instance [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bf6de24-c6a5-4b68-ad60-7f582463016b {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:41:38 user nova-compute[75026]:   <uuid>5bf6de24-c6a5-4b68-ad60-7f582463016b</uuid>
Nov 10 19:41:38 user nova-compute[75026]:   <name>instance-00000028</name>
Nov 10 19:41:38 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:41:38 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:41:38 user nova-compute[75026]:   <metadata>
Nov 10 19:41:38 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:41:38 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:41:38 user nova-compute[75026]:       <nova:name>tempest-ServerActionsTestOtherA-server-1250687212</nova:name>
Nov 10 19:41:38 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:41:36</nova:creationTime>
Nov 10 19:41:38 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:41:38 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:41:38 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:41:38 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:41:38 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:41:38 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:41:38 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:41:38 user nova-compute[75026]:       <nova:owner>
Nov 10 19:41:38 user nova-compute[75026]:         <nova:user uuid="b4fcc097fff34ad2b2cc532d269e06bb">tempest-ServerActionsTestOtherA-664805234-project-member</nova:user>
Nov 10 19:41:38 user nova-compute[75026]:         <nova:project uuid="cdef98b8144148229b82888b888d88c5">tempest-ServerActionsTestOtherA-664805234</nova:project>
Nov 10 19:41:38 user nova-compute[75026]:       </nova:owner>
Nov 10 19:41:38 user nova-compute[75026]:       <nova:ports>
Nov 10 19:41:38 user nova-compute[75026]:         <nova:port uuid="fc91a2c1-39c8-48ff-bb26-046aa507a18e">
Nov 10 19:41:38 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:41:38 user nova-compute[75026]:         </nova:port>
Nov 10 19:41:38 user nova-compute[75026]:       </nova:ports>
Nov 10 19:41:38 user nova-compute[75026]:     </nova:instance>
Nov 10 19:41:38 user nova-compute[75026]:   </metadata>
Nov 10 19:41:38 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:41:38 user nova-compute[75026]:     <system>
Nov 10 19:41:38 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:41:38 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:41:38 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:41:38 user nova-compute[75026]:       <entry name="serial">5bf6de24-c6a5-4b68-ad60-7f582463016b</entry>
Nov 10 19:41:38 user nova-compute[75026]:       <entry name="uuid">5bf6de24-c6a5-4b68-ad60-7f582463016b</entry>
Nov 10 19:41:38 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:41:38 user nova-compute[75026]:     </system>
Nov 10 19:41:38 user nova-compute[75026]:   </sysinfo>
Nov 10 19:41:38 user nova-compute[75026]:   <os>
Nov 10 19:41:38 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:41:38 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:41:38 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:41:38 user nova-compute[75026]:   </os>
Nov 10 19:41:38 user nova-compute[75026]:   <features>
Nov 10 19:41:38 user nova-compute[75026]:     <acpi/>
Nov 10 19:41:38 user nova-compute[75026]:     <apic/>
Nov 10 19:41:38 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:41:38 user nova-compute[75026]:   </features>
Nov 10 19:41:38 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:41:38 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:41:38 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:41:38 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:41:38 user nova-compute[75026]:   </clock>
Nov 10 19:41:38 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:41:38 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:41:38 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:41:38 user nova-compute[75026]:   </cpu>
Nov 10 19:41:38 user nova-compute[75026]:   <devices>
Nov 10 19:41:38 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:41:38 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:41:38 user nova-compute[75026]:       <source dev="/dev/sdd"/>
Nov 10 19:41:38 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:41:38 user nova-compute[75026]:       <serial>4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee</serial>
Nov 10 19:41:38 user nova-compute[75026]:     </disk>
Nov 10 19:41:38 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:41:38 user nova-compute[75026]:       <mac address="fa:16:3e:bc:60:f8"/>
Nov 10 19:41:38 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:41:38 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:41:38 user nova-compute[75026]:       <target dev="tapfc91a2c1-39"/>
Nov 10 19:41:38 user nova-compute[75026]:     </interface>
Nov 10 19:41:38 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:41:38 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/5bf6de24-c6a5-4b68-ad60-7f582463016b/console.log" append="off"/>
Nov 10 19:41:38 user nova-compute[75026]:     </serial>
Nov 10 19:41:38 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:41:38 user nova-compute[75026]:     <video>
Nov 10 19:41:38 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:41:38 user nova-compute[75026]:     </video>
Nov 10 19:41:38 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:41:38 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:41:38 user nova-compute[75026]:     </rng>
Nov 10 19:41:38 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:41:38 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:41:38 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:41:38 user nova-compute[75026]:     </memballoon>
Nov 10 19:41:38 user nova-compute[75026]:   </devices>
Nov 10 19:41:38 user nova-compute[75026]: </domain>
Nov 10 19:41:38 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1250687212',display_name='tempest-ServerActionsTestOtherA-server-1250687212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1250687212',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-un001tri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=5bf6de24-c6a5-4b68-ad60-7f582463016b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG os_vif [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7c8f527-d647-5e73-a474-44f2649aa092', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc91a2c1-39, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc91a2c1-39, col_values=(('qos', UUID('de99b4fa-dc82-420f-af29-6316af95e347')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc91a2c1-39, col_values=(('external_ids', {'iface-id': 'fc91a2c1-39c8-48ff-bb26-046aa507a18e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:60:f8', 'vm-uuid': '5bf6de24-c6a5-4b68-ad60-7f582463016b'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:38 user nova-compute[75026]: INFO os_vif [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39')
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:41:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No VIF found with MAC fa:16:3e:bc:60:f8, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-27a49a9c-67c6-4888-bbd8-2edfe165355b req-2733e059-64bf-45fa-a059-759059cf3fa9 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-27a49a9c-67c6-4888-bbd8-2edfe165355b req-2733e059-64bf-45fa-a059-759059cf3fa9 service nova] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-27a49a9c-67c6-4888-bbd8-2edfe165355b req-2733e059-64bf-45fa-a059-759059cf3fa9 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-27a49a9c-67c6-4888-bbd8-2edfe165355b req-2733e059-64bf-45fa-a059-759059cf3fa9 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-27a49a9c-67c6-4888-bbd8-2edfe165355b req-2733e059-64bf-45fa-a059-759059cf3fa9 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] No waiting events found dispatching network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:39 user nova-compute[75026]: WARNING nova.compute.manager [req-27a49a9c-67c6-4888-bbd8-2edfe165355b req-2733e059-64bf-45fa-a059-759059cf3fa9 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received unexpected event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e for instance with vm_state building and task_state spawning.
Nov 10 19:41:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-8c4de61d-5bdf-4e95-9e7c-345161864f96 req-0dba5434-6584-4d1b-8ae9-0ea67ef5ce8f service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c4de61d-5bdf-4e95-9e7c-345161864f96 req-0dba5434-6584-4d1b-8ae9-0ea67ef5ce8f service nova] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c4de61d-5bdf-4e95-9e7c-345161864f96 req-0dba5434-6584-4d1b-8ae9-0ea67ef5ce8f service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c4de61d-5bdf-4e95-9e7c-345161864f96 req-0dba5434-6584-4d1b-8ae9-0ea67ef5ce8f service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-8c4de61d-5bdf-4e95-9e7c-345161864f96 req-0dba5434-6584-4d1b-8ae9-0ea67ef5ce8f service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] No waiting events found dispatching network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:41:42 user nova-compute[75026]: WARNING nova.compute.manager [req-8c4de61d-5bdf-4e95-9e7c-345161864f96 req-0dba5434-6584-4d1b-8ae9-0ea67ef5ce8f service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received unexpected event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e for instance with vm_state building and task_state spawning.
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:41:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance spawned successfully.
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:41:42 user nova-compute[75026]: INFO nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 10 19:41:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:41:42 user nova-compute[75026]: INFO nova.compute.manager [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Took 37.78 seconds to build instance.
Nov 10 19:41:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-57f72c7c-c567-4206-972a-ae8aa314aa65 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.899s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:41:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:41:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:41:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyoRqUME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:42:04 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:04 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:04 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0c1ff7-5112-4265-9386-63ab80b1d5f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:42:04 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[76818f67-ae8a-40ca-b947-1d1a1459ee09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4] added
Nov 10 19:42:04 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc6d96-3c53-4758-a773-f049468fc6e8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1933bb4-3580-42da-baa4-4c1222069d7e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyoRqUME {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyoRqUME" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff5028-76ed-4f00-98b7-1e15e2481cc8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LyoRqUME'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a2ea5d-e7bb-4898-a161-ee580d93741e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[649937b8-1735-4099-84d1-78fc8a2667c9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:05 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:05 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec768e-0a78-4a11-9388-fa2c8d551a66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260]
Nov 10 19:42:05 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260] successful.
Nov 10 19:42:05 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[78475f57-acec-4596-882e-be484f7a7eb6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[07525ef9-6809-4b52-8b74-674783f93d98]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:05 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:05 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45583963-f333-49e9-bb3b-b9a60b3d813f]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:05 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyoRqUME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23637313230643361', 'path': '/dev/sdg'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637313230643361', 'path': '/dev/sdg'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'flavor' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:42:06 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:42:06 user nova-compute[75026]:   <source dev="/dev/sdg"/>
Nov 10 19:42:06 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:42:06 user nova-compute[75026]:   <serial>afc4a073-7103-465b-92df-ebe7d42ac1b4</serial>
Nov 10 19:42:06 user nova-compute[75026]: </disk>
Nov 10 19:42:06 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No VIF found with MAC fa:16:3e:03:c4:a6, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:42:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1c4e1060-4cbd-445c-a47d-93a572e673b9 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.127s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCEmgcGY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:42:17 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:17 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:17 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9380f3fd-499b-4cb9-8dab-07ba97916f7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:42:17 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c048c4-35cd-4271-bf5e-56c906567fe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb] added
Nov 10 19:42:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62c5cd1-0848-4863-9470-c2b84d11f1e8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ca4bd5-06f0-4e66-8340-6a6f44708ef3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCEmgcGY {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCEmgcGY" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ff1ff8-3c59-44dc-81a4-7142d5cd8081]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCEmgcGY'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a6233b-72ba-467a-8283-0720aed44d52]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[30081a29-333f-408a-8e25-7ff60b724bef]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0671b3-06fb-4ce2-b851-2c8146bccc7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb, portal: 172.16.0.220,3260]
Nov 10 19:42:17 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb, portal: 172.16.0.220,3260] successful.
Nov 10 19:42:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c730fbb-0aec-4e48-b3de-9557c879d006]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[495f6ccb-181e-4fbe-9696-08c56a228e14]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb (non-flash)
Nov 10 19:42:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:17 user nova-compute[75026]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb (non-flash)
Nov 10 19:42:17 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f861a-dd9b-485b-becf-e53d3420a350]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:42:17 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCEmgcGY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23532613935613634', 'path': '/dev/sdh'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532613935613634', 'path': '/dev/sdh'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG nova.objects.instance [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lazy-loading 'flavor' on Instance uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:42:18 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:42:18 user nova-compute[75026]:   <source dev="/dev/sdh"/>
Nov 10 19:42:18 user nova-compute[75026]:   <target dev="vdc" bus="virtio"/>
Nov 10 19:42:18 user nova-compute[75026]:   <serial>ffa73d45-dba8-4769-918d-3bd76feceefb</serial>
Nov 10 19:42:18 user nova-compute[75026]: </disk>
Nov 10 19:42:18 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:42:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] No VIF found with MAC fa:16:3e:d2:2e:9f, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:42:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-3374795e-4c36-4337-b381-849b71c30a8e tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 77.244s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:19 user nova-compute[75026]: INFO nova.compute.manager [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Detaching volume ffa73d45-dba8-4769-918d-3bd76feceefb
Nov 10 19:42:19 user nova-compute[75026]: INFO nova.virt.block_device [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Attempting to driver detach volume ffa73d45-dba8-4769-918d-3bd76feceefb from mountpoint /dev/vdc
Nov 10 19:42:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Attempting to detach device vdc from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:42:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:42:19 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:42:19 user nova-compute[75026]:   <source dev="/dev/sdh"/>
Nov 10 19:42:19 user nova-compute[75026]:   <target dev="vdc" bus="virtio"/>
Nov 10 19:42:19 user nova-compute[75026]:   <serial>ffa73d45-dba8-4769-918d-3bd76feceefb</serial>
Nov 10 19:42:19 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 19:42:19 user nova-compute[75026]: </disk>
Nov 10 19:42:19 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:42:19 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Successfully detached device vdc from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 from the persistent domain config.
Nov 10 19:42:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:42:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:42:19 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:42:19 user nova-compute[75026]:   <source dev="/dev/sdh"/>
Nov 10 19:42:19 user nova-compute[75026]:   <target dev="vdc" bus="virtio"/>
Nov 10 19:42:19 user nova-compute[75026]:   <serial>ffa73d45-dba8-4769-918d-3bd76feceefb</serial>
Nov 10 19:42:19 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 19:42:19 user nova-compute[75026]: </disk>
Nov 10 19:42:19 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:42:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:42:22 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:22 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:42:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:42:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=7768MB free_disk=25.100128173828125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b6734c90-d9b3-4705-bb7f-5c5df66e0baf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5bf6de24-c6a5-4b68-ad60-7f582463016b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:42:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:42:27 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:42:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:42:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:42:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:42:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:42:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:42:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:42:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:42:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:42:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:42:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-c28119a1-737e-418f-8ae5-dd6e182b7f86 req-0431b521-d84b-449f-80b5-147016d3edc5 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-c28119a1-737e-418f-8ae5-dd6e182b7f86 req-0431b521-d84b-449f-80b5-147016d3edc5 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing instance network info cache due to event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:42:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c28119a1-737e-418f-8ae5-dd6e182b7f86 req-0431b521-d84b-449f-80b5-147016d3edc5 service nova] Acquiring lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:42:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c28119a1-737e-418f-8ae5-dd6e182b7f86 req-0431b521-d84b-449f-80b5-147016d3edc5 service nova] Acquired lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:42:33 user nova-compute[75026]: DEBUG nova.network.neutron [req-c28119a1-737e-418f-8ae5-dd6e182b7f86 req-0431b521-d84b-449f-80b5-147016d3edc5 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:42:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-c28119a1-737e-418f-8ae5-dd6e182b7f86 req-0431b521-d84b-449f-80b5-147016d3edc5 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updated VIF entry in instance network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:42:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-c28119a1-737e-418f-8ae5-dd6e182b7f86 req-0431b521-d84b-449f-80b5-147016d3edc5 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c28119a1-737e-418f-8ae5-dd6e182b7f86 req-0431b521-d84b-449f-80b5-147016d3edc5 service nova] Releasing lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:42:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-f0526284-cba9-48ed-8ae0-f5190fd2713e req-319b24b8-7451-4a46-953c-5855088a4ea2 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-f0526284-cba9-48ed-8ae0-f5190fd2713e req-319b24b8-7451-4a46-953c-5855088a4ea2 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing instance network info cache due to event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:42:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f0526284-cba9-48ed-8ae0-f5190fd2713e req-319b24b8-7451-4a46-953c-5855088a4ea2 service nova] Acquiring lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:42:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f0526284-cba9-48ed-8ae0-f5190fd2713e req-319b24b8-7451-4a46-953c-5855088a4ea2 service nova] Acquired lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:42:35 user nova-compute[75026]: DEBUG nova.network.neutron [req-f0526284-cba9-48ed-8ae0-f5190fd2713e req-319b24b8-7451-4a46-953c-5855088a4ea2 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:42:36 user nova-compute[75026]: DEBUG nova.network.neutron [req-f0526284-cba9-48ed-8ae0-f5190fd2713e req-319b24b8-7451-4a46-953c-5855088a4ea2 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updated VIF entry in instance network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:42:36 user nova-compute[75026]: DEBUG nova.network.neutron [req-f0526284-cba9-48ed-8ae0-f5190fd2713e req-319b24b8-7451-4a46-953c-5855088a4ea2 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f0526284-cba9-48ed-8ae0-f5190fd2713e req-319b24b8-7451-4a46-953c-5855088a4ea2 service nova] Releasing lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:42:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:40 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 is timed out.
Nov 10 19:42:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Successfully detached device vdc from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 from the live domain config.
Nov 10 19:42:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCEmgcGY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:42:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7184f32-a1e6-4891-aec4-7ddd2254c48e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:42:40 user nova-compute[75026]: No targets found.
Nov 10 19:42:40 user nova-compute[75026]: iSNS:
Nov 10 19:42:40 user nova-compute[75026]: No targets found.
Nov 10 19:42:40 user nova-compute[75026]: STATIC:
Nov 10 19:42:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c
Nov 10 19:42:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0
Nov 10 19:42:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:42:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4
Nov 10 19:42:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb
Nov 10 19:42:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:42:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee
Nov 10 19:42:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:40 user nova-compute[75026]: FIRMWARE:
Nov 10 19:42:40 user nova-compute[75026]: No targets found.
Nov 10 19:42:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:42:40 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:42:40 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[733626b9-41f0-4775-9fc1-1c4130657682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[226d89ed-b8e5-41b4-b8b0-49434825d569]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb (non-flash)
Nov 10 19:42:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:40 user nova-compute[75026]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb (non-flash)
Nov 10 19:42:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0e31990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb'): ({'sdh'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Removing single pathed devices sdh {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e442a9f-748f-49f0-9f12-aacc796b32a8]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5518ee-e553-4074-9cf5-79838251509d]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Flushing IO for device /dev/sdh {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed90b7-2202-4f8e-9feb-81ccf6680807]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2cb25-c2b1-4d50-8e1f-fdfcbae2b596]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] SCSI volumes sdh have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d084cfe-9f4a-484e-babc-330999b52ff2]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b288c88-a752-4ebe-aa57-21e2781698d2]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb, portal: 172.16.0.220,3260]
Nov 10 19:42:40 user nova-compute[75026]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb, portal: 172.16.0.220,3260] successful.
Nov 10 19:42:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa73d45-dba8-4769-918d-3bd76feceefb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e37a1cf-5035-4a12-9b7b-0c615e204e93]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] <== disconnect_volume: return (332ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:42:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:42:41 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lazy-loading 'flavor' on Instance uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d4deb75-842b-4bcf-aaac-3142d1b682c1 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.952s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:42:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:42:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-314c4260-8b13-4986-9bb9-bd888aaeac6d req-ba0fda9f-9d49-4b43-a712-b62a30452595 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-changed-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-314c4260-8b13-4986-9bb9-bd888aaeac6d req-ba0fda9f-9d49-4b43-a712-b62a30452595 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Refreshing instance network info cache due to event network-changed-59405ecb-8bc7-45a9-b819-880c218ed01c. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-314c4260-8b13-4986-9bb9-bd888aaeac6d req-ba0fda9f-9d49-4b43-a712-b62a30452595 service nova] Acquiring lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-314c4260-8b13-4986-9bb9-bd888aaeac6d req-ba0fda9f-9d49-4b43-a712-b62a30452595 service nova] Acquired lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG nova.network.neutron [req-314c4260-8b13-4986-9bb9-bd888aaeac6d req-ba0fda9f-9d49-4b43-a712-b62a30452595 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Refreshing network info cache for port 59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:44 user nova-compute[75026]: INFO nova.compute.manager [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Terminating instance
Nov 10 19:42:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-4eb0bd0a-b85f-4538-84e0-57926fed76b6 req-7f671360-7fe2-42f0-a7ae-c2cb26910f5c service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-vif-unplugged-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4eb0bd0a-b85f-4538-84e0-57926fed76b6 req-7f671360-7fe2-42f0-a7ae-c2cb26910f5c service nova] Acquiring lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4eb0bd0a-b85f-4538-84e0-57926fed76b6 req-7f671360-7fe2-42f0-a7ae-c2cb26910f5c service nova] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4eb0bd0a-b85f-4538-84e0-57926fed76b6 req-7f671360-7fe2-42f0-a7ae-c2cb26910f5c service nova] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-4eb0bd0a-b85f-4538-84e0-57926fed76b6 req-7f671360-7fe2-42f0-a7ae-c2cb26910f5c service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] No waiting events found dispatching network-vif-unplugged-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:42:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-4eb0bd0a-b85f-4538-84e0-57926fed76b6 req-7f671360-7fe2-42f0-a7ae-c2cb26910f5c service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-vif-unplugged-59405ecb-8bc7-45a9-b819-880c218ed01c for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.network.neutron [req-314c4260-8b13-4986-9bb9-bd888aaeac6d req-ba0fda9f-9d49-4b43-a712-b62a30452595 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updated VIF entry in instance network info cache for port 59405ecb-8bc7-45a9-b819-880c218ed01c. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.network.neutron [req-314c4260-8b13-4986-9bb9-bd888aaeac6d req-ba0fda9f-9d49-4b43-a712-b62a30452595 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updating instance_info_cache with network_info: [{"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-314c4260-8b13-4986-9bb9-bd888aaeac6d req-ba0fda9f-9d49-4b43-a712-b62a30452595 service nova] Releasing lock "refresh_cache-0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Instance destroyed successfully.
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lazy-loading 'resources' on Instance uuid 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1695131438',display_name='tempest-TestVolumeBootPattern-server-1695131438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1695131438',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMnIy58P3wCtoNCVwzNVrxmG9zSw6O9vT+lE67779NCJKusyH8zXXjXgZJM0tUvrrv0Xqd0+SBi7Ow1lQL6rn0QFCNPTn2d0AOQQNNkV3fE8r6xC6uo5HJwsfelRUM6XQ==',key_name='tempest-TestVolumeBootPattern-868999340',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:37:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e509e662d27146fba4f51fd55dbe6f83',ramdisk_id='',reservation_id='r-v8pcof0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1182723443',owner_user_name='tempest-TestVolumeBootPattern-1182723443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:37:43Z,user_data=None,user_id='758478b59f94467898696fa7af7cd630',uuid=0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converting VIF {"id": "59405ecb-8bc7-45a9-b819-880c218ed01c", "address": "fa:16:3e:15:0a:ad", "network": {"id": "4f6ea214-60ad-4feb-8e30-5bd746343b72", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-783133648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e509e662d27146fba4f51fd55dbe6f83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59405ecb-8b", "ovs_interfaceid": "59405ecb-8bc7-45a9-b819-880c218ed01c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=59405ecb-8bc7-45a9-b819-880c218ed01c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59405ecb-8b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_vif [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=59405ecb-8bc7-45a9-b819-880c218ed01c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59405ecb-8b') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59405ecb-8b, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=583dfbab-a5fd-4758-8b64-45748b5f11f7) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:45 user nova-compute[75026]: INFO os_vif [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=59405ecb-8bc7-45a9-b819-880c218ed01c,network=Network(4f6ea214-60ad-4feb-8e30-5bd746343b72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59405ecb-8b')
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUWqNMgc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:42:45 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dd50b2-2b7f-4d19-ad74-aedbc677baeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:42:45 user nova-compute[75026]: No targets found.
Nov 10 19:42:45 user nova-compute[75026]: iSNS:
Nov 10 19:42:45 user nova-compute[75026]: No targets found.
Nov 10 19:42:45 user nova-compute[75026]: STATIC:
Nov 10 19:42:45 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c
Nov 10 19:42:45 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:45 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:45 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0
Nov 10 19:42:45 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:45 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:45 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:42:45 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:45 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:45 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4
Nov 10 19:42:45 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:45 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:45 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:42:45 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:45 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:45 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee
Nov 10 19:42:45 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:45 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:45 user nova-compute[75026]: FIRMWARE:
Nov 10 19:42:45 user nova-compute[75026]: No targets found.
Nov 10 19:42:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:42:45 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:42:45 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b705ea5c-3615-43d2-86b6-c96268180099]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e504a60-1d69-4404-b4e6-00e13d2762fc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:45 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed8067e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1e9e3e-3c6d-44f2-8dfa-ed77c4c27e80]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[198f7fda-4bb6-4e1e-b1b3-ee97b9d3f2b4]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0994abe-2fef-48eb-928d-557dd0959cf1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0d65a9-2656-4025-98b0-7365867ed710]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f985a2c-c055-4667-b4c3-5fed31ddf50b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c2c52-4c1d-49ca-9884-7d3a51817288]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260]
Nov 10 19:42:45 user nova-compute[75026]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0, portal: 172.16.0.220,3260] successful.
Nov 10 19:42:45 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3aa29c9f-2950-435a-bbe9-293b5a1f6bc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e884e4-1eeb-46ec-8d7e-515fd0fbb922]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] <== disconnect_volume: return (371ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:42:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Deleting instance files /opt/stack/data/nova/instances/0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a_del
Nov 10 19:42:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Deletion of /opt/stack/data/nova/instances/0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a_del complete
Nov 10 19:42:45 user nova-compute[75026]: INFO nova.compute.manager [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 10 19:42:45 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:42:45 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:42:46 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:46 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Took 0.49 seconds to deallocate network for instance.
Nov 10 19:42:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-d6efe2a3-a96f-481d-89d5-74f93abf979c req-38cb972a-2123-42d3-aa21-7f53de26a73d service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-vif-deleted-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:46 user nova-compute[75026]: INFO nova.compute.manager [req-d6efe2a3-a96f-481d-89d5-74f93abf979c req-38cb972a-2123-42d3-aa21-7f53de26a73d service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Neutron deleted interface 59405ecb-8bc7-45a9-b819-880c218ed01c; detaching it from the instance and deleting it from the info cache
Nov 10 19:42:46 user nova-compute[75026]: DEBUG nova.network.neutron [req-d6efe2a3-a96f-481d-89d5-74f93abf979c req-38cb972a-2123-42d3-aa21-7f53de26a73d service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-d6efe2a3-a96f-481d-89d5-74f93abf979c req-38cb972a-2123-42d3-aa21-7f53de26a73d service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Detach interface failed, port_id=59405ecb-8bc7-45a9-b819-880c218ed01c, reason: Instance 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:42:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-ae7de257-a9e6-4010-9fa2-83b626ccb4a4 req-6117fa33-8992-42ee-a66e-0f742c22d879 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received event network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ae7de257-a9e6-4010-9fa2-83b626ccb4a4 req-6117fa33-8992-42ee-a66e-0f742c22d879 service nova] Acquiring lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ae7de257-a9e6-4010-9fa2-83b626ccb4a4 req-6117fa33-8992-42ee-a66e-0f742c22d879 service nova] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ae7de257-a9e6-4010-9fa2-83b626ccb4a4 req-6117fa33-8992-42ee-a66e-0f742c22d879 service nova] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-ae7de257-a9e6-4010-9fa2-83b626ccb4a4 req-6117fa33-8992-42ee-a66e-0f742c22d879 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] No waiting events found dispatching network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:42:47 user nova-compute[75026]: WARNING nova.compute.manager [req-ae7de257-a9e6-4010-9fa2-83b626ccb4a4 req-6117fa33-8992-42ee-a66e-0f742c22d879 service nova] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Received unexpected event network-vif-plugged-59405ecb-8bc7-45a9-b819-880c218ed01c for instance with vm_state active and task_state deleting.
Nov 10 19:42:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:42:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:42:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:49 user nova-compute[75026]: INFO nova.compute.manager [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Rebooting instance
Nov 10 19:42:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:42:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquired lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:42:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG nova.network.neutron [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Releasing lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-c9baa0a3-c9b5-42f7-8384-c30cb3fa358e req-c700b1c2-f21f-4c6e-936e-8f46e97d15a3 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-unplugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c9baa0a3-c9b5-42f7-8384-c30cb3fa358e req-c700b1c2-f21f-4c6e-936e-8f46e97d15a3 service nova] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c9baa0a3-c9b5-42f7-8384-c30cb3fa358e req-c700b1c2-f21f-4c6e-936e-8f46e97d15a3 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c9baa0a3-c9b5-42f7-8384-c30cb3fa358e req-c700b1c2-f21f-4c6e-936e-8f46e97d15a3 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:50 user nova-compute[75026]: DEBUG nova.compute.manager [req-c9baa0a3-c9b5-42f7-8384-c30cb3fa358e req-c700b1c2-f21f-4c6e-936e-8f46e97d15a3 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] No waiting events found dispatching network-vif-unplugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:42:50 user nova-compute[75026]: WARNING nova.compute.manager [req-c9baa0a3-c9b5-42f7-8384-c30cb3fa358e req-c700b1c2-f21f-4c6e-936e-8f46e97d15a3 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received unexpected event network-vif-unplugged-11d38f14-6245-494b-b6c1-a80f36322ded for instance with vm_state active and task_state reboot_started_hard.
Nov 10 19:42:51 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Instance destroyed successfully.
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.objects.instance [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'resources' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-697677391',display_name='tempest-TestMinimumBasicScenario-server-697677391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-697677391',id=38,image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9iJhoV2AQmlb4E4tOUu9pK1P1y6TbuVhEZHslkEnMBCG7TKJFJgekMxSamW7Co3bXviUcXuGTmeD65Hic4t5VK0PflhuWDH2hlMRNB1YnAgAuReT6a+kjcydoJxWNbyg==',key_name='tempest-TestMinimumBasicScenario-1209618325',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:39:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-3yzzzsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:42:50Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=352c397d-7e92-4b2c-8e4a-9482c4b74326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_vif [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11d38f14-62, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cfd014e-82f9-4afb-91d4-8f237c422f65) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:51 user nova-compute[75026]: INFO os_vif [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62')
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyoRqUME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:42:51 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c98fb2-fcb8-4d77-891e-e042e8ccbbba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:42:51 user nova-compute[75026]: No targets found.
Nov 10 19:42:51 user nova-compute[75026]: iSNS:
Nov 10 19:42:51 user nova-compute[75026]: No targets found.
Nov 10 19:42:51 user nova-compute[75026]: STATIC:
Nov 10 19:42:51 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c
Nov 10 19:42:51 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:51 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:51 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:42:51 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:51 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:51 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4
Nov 10 19:42:51 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:51 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:51 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:42:51 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:51 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:51 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee
Nov 10 19:42:51 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:51 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:51 user nova-compute[75026]: FIRMWARE:
Nov 10 19:42:51 user nova-compute[75026]: No targets found.
Nov 10 19:42:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:42:51 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:42:51 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02af36b3-6f55-44a5-a27f-fa11332636da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7570720-136e-48ab-9392-e38a697b6476]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0e33640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4'): ({'sdg'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Removing single pathed devices sdg {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a0ddcc-dc4d-44a1-90d4-ccd755396a94]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5641d946-f123-40de-b820-9098543bee61]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flushing IO for device /dev/sdg {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea31ffcd-6d2a-47d0-93dc-1e7e022f8192]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b96b609-febc-4a50-9c34-6a3e681d8026]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] SCSI volumes sdg have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8e00ba-efb7-47fa-a171-f42b95aecaa4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d58a68-913d-4e74-99f7-9bc1dd878d2b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260]
Nov 10 19:42:51 user nova-compute[75026]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260] successful.
Nov 10 19:42:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bec1db5-7063-4263-899b-bdf42fa414b9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] <== disconnect_volume: return (340ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Start _get_guest_xml network_info=[{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=201ce38e-7d35-40dd-97ac-e4300b00561a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': '201ce38e-7d35-40dd-97ac-e4300b00561a'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'fa92cc25-f68b-4e07-b1af-86181193768e', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyoRqUME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '352c397d-7e92-4b2c-8e4a-9482c4b74326', 'attached_at': '', 'detached_at': '', 'volume_id': 'afc4a073-7103-465b-92df-ebe7d42ac1b4', 'serial': 'afc4a073-7103-465b-92df-ebe7d42ac1b4'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:42:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:42:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=201ce38e-7d35-40dd-97ac-e4300b00561a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.objects.instance [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'vcpu_model' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.objects.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Object Instance<352c397d-7e92-4b2c-8e4a-9482c4b74326> lazy-loaded attributes: resources,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyoRqUME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:42:51 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:51 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:51 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b1eb37-bcf3-4174-9769-dd30cedfbede]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:42:51 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c908b9-6f1d-4a97-addc-3b84fc178786]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4] added
Nov 10 19:42:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[791f441c-bf6a-4ab2-86f7-147c06daff23]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[927453a1-7d5a-4883-be8b-9a1937c53bcd]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyoRqUME {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LyoRqUME" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a8acaa-908b-4587-8eb1-120943e263b4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LyoRqUME'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4ba95d-6127-4f6b-8ff7-ad2604253972]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4197362c-349d-47d3-b208-1cf72753a9f5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:51 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c290055b-e471-47f4-acb0-cf968d7b6d73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260]
Nov 10 19:42:52 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260] successful.
Nov 10 19:42:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5eb66d-b496-4c68-8c96-708d4d42d906]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9a8137-d184-498c-815c-e448d5aced7b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:52 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:52 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:52 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:52 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:52 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:52 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:52 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:52 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eea0ded-b8c4-4526-baaa-c85b42aa5570]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-2a8b14a0-ea1a-4d14-aa05-c84139736743 req-45f08d4c-14d9-4857-a9a4-65737fb6f9d9 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2a8b14a0-ea1a-4d14-aa05-c84139736743 req-45f08d4c-14d9-4857-a9a4-65737fb6f9d9 service nova] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2a8b14a0-ea1a-4d14-aa05-c84139736743 req-45f08d4c-14d9-4857-a9a4-65737fb6f9d9 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2a8b14a0-ea1a-4d14-aa05-c84139736743 req-45f08d4c-14d9-4857-a9a4-65737fb6f9d9 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-2a8b14a0-ea1a-4d14-aa05-c84139736743 req-45f08d4c-14d9-4857-a9a4-65737fb6f9d9 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] No waiting events found dispatching network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:42:52 user nova-compute[75026]: WARNING nova.compute.manager [req-2a8b14a0-ea1a-4d14-aa05-c84139736743 req-45f08d4c-14d9-4857-a9a4-65737fb6f9d9 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received unexpected event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded for instance with vm_state active and task_state reboot_started_hard.
Nov 10 19:42:53 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyoRqUME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23637313230643361', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637313230643361', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-697677391',display_name='tempest-TestMinimumBasicScenario-server-697677391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-697677391',id=38,image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9iJhoV2AQmlb4E4tOUu9pK1P1y6TbuVhEZHslkEnMBCG7TKJFJgekMxSamW7Co3bXviUcXuGTmeD65Hic4t5VK0PflhuWDH2hlMRNB1YnAgAuReT6a+kjcydoJxWNbyg==',key_name='tempest-TestMinimumBasicScenario-1209618325',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:39:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-3yzzzsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:42:50Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=352c397d-7e92-4b2c-8e4a-9482c4b74326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.objects.instance [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'pci_devices' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.objects.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Object Instance<352c397d-7e92-4b2c-8e4a-9482c4b74326> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:42:53 user nova-compute[75026]:   <uuid>352c397d-7e92-4b2c-8e4a-9482c4b74326</uuid>
Nov 10 19:42:53 user nova-compute[75026]:   <name>instance-00000026</name>
Nov 10 19:42:53 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:42:53 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:42:53 user nova-compute[75026]:   <metadata>
Nov 10 19:42:53 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:42:53 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:42:53 user nova-compute[75026]:       <nova:name>tempest-TestMinimumBasicScenario-server-697677391</nova:name>
Nov 10 19:42:53 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:42:51</nova:creationTime>
Nov 10 19:42:53 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:42:53 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:42:53 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:42:53 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:42:53 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:42:53 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:42:53 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:42:53 user nova-compute[75026]:       <nova:owner>
Nov 10 19:42:53 user nova-compute[75026]:         <nova:user uuid="68746f97690e4928acbcade25680b895">tempest-TestMinimumBasicScenario-966338622-project-member</nova:user>
Nov 10 19:42:53 user nova-compute[75026]:         <nova:project uuid="1772dacf6532415e9fad0345cc6b6f8f">tempest-TestMinimumBasicScenario-966338622</nova:project>
Nov 10 19:42:53 user nova-compute[75026]:       </nova:owner>
Nov 10 19:42:53 user nova-compute[75026]:       <nova:root type="image" uuid="201ce38e-7d35-40dd-97ac-e4300b00561a"/>
Nov 10 19:42:53 user nova-compute[75026]:       <nova:ports>
Nov 10 19:42:53 user nova-compute[75026]:         <nova:port uuid="11d38f14-6245-494b-b6c1-a80f36322ded">
Nov 10 19:42:53 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 19:42:53 user nova-compute[75026]:         </nova:port>
Nov 10 19:42:53 user nova-compute[75026]:       </nova:ports>
Nov 10 19:42:53 user nova-compute[75026]:     </nova:instance>
Nov 10 19:42:53 user nova-compute[75026]:   </metadata>
Nov 10 19:42:53 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:42:53 user nova-compute[75026]:     <system>
Nov 10 19:42:53 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:42:53 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:42:53 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:42:53 user nova-compute[75026]:       <entry name="serial">352c397d-7e92-4b2c-8e4a-9482c4b74326</entry>
Nov 10 19:42:53 user nova-compute[75026]:       <entry name="uuid">352c397d-7e92-4b2c-8e4a-9482c4b74326</entry>
Nov 10 19:42:53 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:42:53 user nova-compute[75026]:     </system>
Nov 10 19:42:53 user nova-compute[75026]:   </sysinfo>
Nov 10 19:42:53 user nova-compute[75026]:   <os>
Nov 10 19:42:53 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:42:53 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:42:53 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:42:53 user nova-compute[75026]:   </os>
Nov 10 19:42:53 user nova-compute[75026]:   <features>
Nov 10 19:42:53 user nova-compute[75026]:     <acpi/>
Nov 10 19:42:53 user nova-compute[75026]:     <apic/>
Nov 10 19:42:53 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:42:53 user nova-compute[75026]:   </features>
Nov 10 19:42:53 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:42:53 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:42:53 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:42:53 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:42:53 user nova-compute[75026]:   </clock>
Nov 10 19:42:53 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:42:53 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:42:53 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:42:53 user nova-compute[75026]:   </cpu>
Nov 10 19:42:53 user nova-compute[75026]:   <devices>
Nov 10 19:42:53 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:42:53 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:42:53 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk"/>
Nov 10 19:42:53 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:42:53 user nova-compute[75026]:     </disk>
Nov 10 19:42:53 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:42:53 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:42:53 user nova-compute[75026]:       <source dev="/dev/sdb"/>
Nov 10 19:42:53 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:42:53 user nova-compute[75026]:       <serial>afc4a073-7103-465b-92df-ebe7d42ac1b4</serial>
Nov 10 19:42:53 user nova-compute[75026]:     </disk>
Nov 10 19:42:53 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:42:53 user nova-compute[75026]:       <mac address="fa:16:3e:03:c4:a6"/>
Nov 10 19:42:53 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:42:53 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:42:53 user nova-compute[75026]:       <target dev="tap11d38f14-62"/>
Nov 10 19:42:53 user nova-compute[75026]:     </interface>
Nov 10 19:42:53 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:42:53 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/console.log" append="off"/>
Nov 10 19:42:53 user nova-compute[75026]:     </serial>
Nov 10 19:42:53 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:42:53 user nova-compute[75026]:     <video>
Nov 10 19:42:53 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:42:53 user nova-compute[75026]:     </video>
Nov 10 19:42:53 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:42:53 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:42:53 user nova-compute[75026]:     </rng>
Nov 10 19:42:53 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:42:53 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:42:53 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:42:53 user nova-compute[75026]:     </memballoon>
Nov 10 19:42:53 user nova-compute[75026]:   </devices>
Nov 10 19:42:53 user nova-compute[75026]: </domain>
Nov 10 19:42:53 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.objects.instance [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'trusted_certs' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.objects.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Object Instance<352c397d-7e92-4b2c-8e4a-9482c4b74326> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 --force-share --output=json" returned: 0 in 0.242s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Cannot resize image /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.objects.instance [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'migration_context' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.objects.base [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Object Instance<352c397d-7e92-4b2c-8e4a-9482c4b74326> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-697677391',display_name='tempest-TestMinimumBasicScenario-server-697677391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-697677391',id=38,image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9iJhoV2AQmlb4E4tOUu9pK1P1y6TbuVhEZHslkEnMBCG7TKJFJgekMxSamW7Co3bXviUcXuGTmeD65Hic4t5VK0PflhuWDH2hlMRNB1YnAgAuReT6a+kjcydoJxWNbyg==',key_name='tempest-TestMinimumBasicScenario-1209618325',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:39:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-3yzzzsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:42:50Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=352c397d-7e92-4b2c-8e4a-9482c4b74326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:42:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG os_vif [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bb925ce-f879-5830-a11a-c4f377b591f8', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11d38f14-62, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11d38f14-62, col_values=(('qos', UUID('46a1640e-a9dd-49a2-abae-fcf6eeea8e98')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11d38f14-62, col_values=(('external_ids', {'iface-id': '11d38f14-6245-494b-b6c1-a80f36322ded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:c4:a6', 'vm-uuid': '352c397d-7e92-4b2c-8e4a-9482c4b74326'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:54 user nova-compute[75026]: INFO os_vif [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62')
Nov 10 19:42:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-e455b8f0-f169-4a4e-b125-9c267bd66b88 req-b491ef1b-a88f-4c14-b85a-57d5822b799c service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e455b8f0-f169-4a4e-b125-9c267bd66b88 req-b491ef1b-a88f-4c14-b85a-57d5822b799c service nova] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e455b8f0-f169-4a4e-b125-9c267bd66b88 req-b491ef1b-a88f-4c14-b85a-57d5822b799c service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e455b8f0-f169-4a4e-b125-9c267bd66b88 req-b491ef1b-a88f-4c14-b85a-57d5822b799c service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-e455b8f0-f169-4a4e-b125-9c267bd66b88 req-b491ef1b-a88f-4c14-b85a-57d5822b799c service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] No waiting events found dispatching network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:42:55 user nova-compute[75026]: WARNING nova.compute.manager [req-e455b8f0-f169-4a4e-b125-9c267bd66b88 req-b491ef1b-a88f-4c14-b85a-57d5822b799c service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received unexpected event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded for instance with vm_state active and task_state reboot_started_hard.
Nov 10 19:42:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-37ff1f85-b29f-4453-9d5c-83278fdc2cd5 req-2b35033c-b55a-4185-becd-04c32855483e service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-changed-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-37ff1f85-b29f-4453-9d5c-83278fdc2cd5 req-2b35033c-b55a-4185-becd-04c32855483e service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Refreshing instance network info cache due to event network-changed-b2b60a7f-6664-4ecd-8cf6-c4803546ee32. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-37ff1f85-b29f-4453-9d5c-83278fdc2cd5 req-2b35033c-b55a-4185-becd-04c32855483e service nova] Acquiring lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-37ff1f85-b29f-4453-9d5c-83278fdc2cd5 req-2b35033c-b55a-4185-becd-04c32855483e service nova] Acquired lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:42:55 user nova-compute[75026]: DEBUG nova.network.neutron [req-37ff1f85-b29f-4453-9d5c-83278fdc2cd5 req-2b35033c-b55a-4185-becd-04c32855483e service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Refreshing network info cache for port b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:42:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:56 user nova-compute[75026]: DEBUG nova.network.neutron [req-37ff1f85-b29f-4453-9d5c-83278fdc2cd5 req-2b35033c-b55a-4185-becd-04c32855483e service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updated VIF entry in instance network info cache for port b2b60a7f-6664-4ecd-8cf6-c4803546ee32. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:42:56 user nova-compute[75026]: DEBUG nova.network.neutron [req-37ff1f85-b29f-4453-9d5c-83278fdc2cd5 req-2b35033c-b55a-4185-becd-04c32855483e service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-37ff1f85-b29f-4453-9d5c-83278fdc2cd5 req-2b35033c-b55a-4185-becd-04c32855483e service nova] Releasing lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:42:57 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Instance rebooted successfully.
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-e249f2b1-d402-44f0-b71f-8eb1d93e8e88 req-159bd0ee-e2f5-4785-b1d8-50fdd31ac478 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e249f2b1-d402-44f0-b71f-8eb1d93e8e88 req-159bd0ee-e2f5-4785-b1d8-50fdd31ac478 service nova] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e249f2b1-d402-44f0-b71f-8eb1d93e8e88 req-159bd0ee-e2f5-4785-b1d8-50fdd31ac478 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e249f2b1-d402-44f0-b71f-8eb1d93e8e88 req-159bd0ee-e2f5-4785-b1d8-50fdd31ac478 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-e249f2b1-d402-44f0-b71f-8eb1d93e8e88 req-159bd0ee-e2f5-4785-b1d8-50fdd31ac478 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] No waiting events found dispatching network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:42:57 user nova-compute[75026]: WARNING nova.compute.manager [req-e249f2b1-d402-44f0-b71f-8eb1d93e8e88 req-159bd0ee-e2f5-4785-b1d8-50fdd31ac478 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received unexpected event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded for instance with vm_state active and task_state reboot_started_hard.
Nov 10 19:42:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-edcf42b4-3503-4ecd-bdb6-a4fbb11bc39b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.075s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-92908910-f7c2-418c-8419-e61b5da9f353 req-6ed3717d-67e7-423a-843b-22a77f79f595 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-changed-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.compute.manager [req-92908910-f7c2-418c-8419-e61b5da9f353 req-6ed3717d-67e7-423a-843b-22a77f79f595 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Refreshing instance network info cache due to event network-changed-fc91a2c1-39c8-48ff-bb26-046aa507a18e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-92908910-f7c2-418c-8419-e61b5da9f353 req-6ed3717d-67e7-423a-843b-22a77f79f595 service nova] Acquiring lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-92908910-f7c2-418c-8419-e61b5da9f353 req-6ed3717d-67e7-423a-843b-22a77f79f595 service nova] Acquired lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.network.neutron [req-92908910-f7c2-418c-8419-e61b5da9f353 req-6ed3717d-67e7-423a-843b-22a77f79f595 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Refreshing network info cache for port fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Stashing vm_state: active {{(pid=75026) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:57 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:42:57 user nova-compute[75026]: INFO nova.compute.claims [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Claim successful on node user
Nov 10 19:42:58 user nova-compute[75026]: INFO nova.compute.resource_tracker [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating resource usage from migration e5e7a055-f415-420c-a9a3-b6694d810552
Nov 10 19:42:58 user nova-compute[75026]: DEBUG nova.network.neutron [req-92908910-f7c2-418c-8419-e61b5da9f353 req-6ed3717d-67e7-423a-843b-22a77f79f595 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updated VIF entry in instance network info cache for port fc91a2c1-39c8-48ff-bb26-046aa507a18e. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG nova.network.neutron [req-92908910-f7c2-418c-8419-e61b5da9f353 req-6ed3717d-67e7-423a-843b-22a77f79f595 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating instance_info_cache with network_info: [{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-92908910-f7c2-418c-8419-e61b5da9f353 req-6ed3717d-67e7-423a-843b-22a77f79f595 service nova] Releasing lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.495s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:58 user nova-compute[75026]: INFO nova.compute.manager [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Migrating
Nov 10 19:42:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquired lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG nova.network.neutron [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG nova.network.neutron [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating instance_info_cache with network_info: [{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:42:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Releasing lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Starting migrate_disk_and_power_off {{(pid=75026) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-1b7f8951-f0fb-46fc-af7e-d8987145664b req-89f4c9a2-e127-4d5a-b385-7d38c2dbf586 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-unplugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b7f8951-f0fb-46fc-af7e-d8987145664b req-89f4c9a2-e127-4d5a-b385-7d38c2dbf586 service nova] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b7f8951-f0fb-46fc-af7e-d8987145664b req-89f4c9a2-e127-4d5a-b385-7d38c2dbf586 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-1b7f8951-f0fb-46fc-af7e-d8987145664b req-89f4c9a2-e127-4d5a-b385-7d38c2dbf586 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG nova.compute.manager [req-1b7f8951-f0fb-46fc-af7e-d8987145664b req-89f4c9a2-e127-4d5a-b385-7d38c2dbf586 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] No waiting events found dispatching network-vif-unplugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:42:59 user nova-compute[75026]: WARNING nova.compute.manager [req-1b7f8951-f0fb-46fc-af7e-d8987145664b req-89f4c9a2-e127-4d5a-b385-7d38c2dbf586 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received unexpected event network-vif-unplugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e for instance with vm_state active and task_state resize_migrating.
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance destroyed successfully.
Nov 10 19:42:59 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1250687212',display_name='tempest-ServerActionsTestOtherA-server-1250687212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1250687212',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:41:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-un001tri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=5bf6de24-c6a5-4b68-ad60-7f582463016b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-236681753-network", "vif_mac": "fa:16:3e:bc:60:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-236681753-network", "vif_mac": "fa:16:3e:bc:60:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_vif [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc91a2c1-39, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de99b4fa-dc82-420f-af29-6316af95e347) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:42:59 user nova-compute[75026]: INFO os_vif [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39')
Nov 10 19:42:59 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWsJfgjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:42:59 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de84fb5-c0f0-44a4-a05c-d8b2cdbf0162]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:42:59 user nova-compute[75026]: No targets found.
Nov 10 19:42:59 user nova-compute[75026]: iSNS:
Nov 10 19:42:59 user nova-compute[75026]: No targets found.
Nov 10 19:42:59 user nova-compute[75026]: STATIC:
Nov 10 19:42:59 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c
Nov 10 19:42:59 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:59 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:59 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:42:59 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:59 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:59 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4
Nov 10 19:42:59 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:59 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:59 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:42:59 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:59 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:59 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee
Nov 10 19:42:59 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:42:59 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:42:59 user nova-compute[75026]: FIRMWARE:
Nov 10 19:42:59 user nova-compute[75026]: No targets found.
Nov 10 19:42:59 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:42:59 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:42:59 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d1de25-4f4c-4fb5-a4f8-94951df74005]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4292dd1-c6b6-41eb-a49d-e89bf971a16d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:59 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:59 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:59 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:59 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:59 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:42:59 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:42:59 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:42:59 user nova-compute[75026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:42:59 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:42:59 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed801827a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee'): ({'sdd'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Removing single pathed devices sdd {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d002531-d471-4b14-96be-24b086123937]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:42:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c6040-ccc5-4147-bf78-669d9069aa98]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flushing IO for device /dev/sdd {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0b4e2f-968a-4f5d-9ee4-2b94e020eaa0]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3604dd90-19a6-492e-b6eb-d92bce1a6fdd]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_34f5597d',) {{(pid=86097) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[260a7d65-ddf5-4f96-9c86-f77cc5ea9845]: (4, None) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65afc05-9404-430d-8e35-52f09d04e928]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c4f726-dcc1-4c88-b69e-41435d029db6]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260]
Nov 10 19:43:00 user nova-compute[75026]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260] successful.
Nov 10 19:43:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18c3742-8b7f-43d8-b363-63326e142445]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== disconnect_volume: return (383ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:43:00 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:43:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-00a599d0-f6c0-41c7-8f9b-31e508d05471 req-4c1fb609-dde9-40bf-bac5-a629822f0159 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:43:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-00a599d0-f6c0-41c7-8f9b-31e508d05471 req-4c1fb609-dde9-40bf-bac5-a629822f0159 service nova] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-00a599d0-f6c0-41c7-8f9b-31e508d05471 req-4c1fb609-dde9-40bf-bac5-a629822f0159 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-00a599d0-f6c0-41c7-8f9b-31e508d05471 req-4c1fb609-dde9-40bf-bac5-a629822f0159 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-00a599d0-f6c0-41c7-8f9b-31e508d05471 req-4c1fb609-dde9-40bf-bac5-a629822f0159 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] No waiting events found dispatching network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:43:01 user nova-compute[75026]: WARNING nova.compute.manager [req-00a599d0-f6c0-41c7-8f9b-31e508d05471 req-4c1fb609-dde9-40bf-bac5-a629822f0159 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received unexpected event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e for instance with vm_state active and task_state resize_migrating.
Nov 10 19:43:01 user nova-compute[75026]: DEBUG nova.network.neutron [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Port fc91a2c1-39c8-48ff-bb26-046aa507a18e binding to destination host user is already ACTIVE {{(pid=75026) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 19:43:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquired lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG nova.network.neutron [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG nova.network.neutron [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating instance_info_cache with network_info: [{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Releasing lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG os_brick.utils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[508831ab-f0e1-44c3-ac71-930102296cd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2492d0be-babe-42de-9dbb-c0dca99cad58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16eca9-3033-4b3b-ad77-a51a0ae02503]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3ed7e9-6d02-4c09-b18c-ae214763a8b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:43:02 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:43:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3d789f-03c4-402e-9e82-78fafea57812]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:43:02 user nova-compute[75026]: DEBUG os_brick.utils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:03 user nova-compute[75026]: WARNING nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid b9e39b1a-3119-456e-b16d-192dbcd66ae3 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 9bcd68f9-db0e-4dd0-a831-c985e575ff9e {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 468562be-d411-4da2-bf90-7cb2b1edacca {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 5bf6de24-c6a5-4b68-ad60-7f582463016b {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "468562be-d411-4da2-bf90-7cb2b1edacca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:03 user nova-compute[75026]: INFO nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "468562be-d411-4da2-bf90-7cb2b1edacca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:10 user nova-compute[75026]: INFO nova.compute.manager [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Detaching volume 9ba2222b-7b87-4c11-82d5-ae4feffb7a1c
Nov 10 19:43:10 user nova-compute[75026]: INFO nova.virt.block_device [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Attempting to driver detach volume 9ba2222b-7b87-4c11-82d5-ae4feffb7a1c from mountpoint /dev/vdb
Nov 10 19:43:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Attempting to detach device vdb from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:43:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:43:10 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:43:10 user nova-compute[75026]:   <source dev="/dev/sdf"/>
Nov 10 19:43:10 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:43:10 user nova-compute[75026]:   <serial>9ba2222b-7b87-4c11-82d5-ae4feffb7a1c</serial>
Nov 10 19:43:10 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:43:10 user nova-compute[75026]: </disk>
Nov 10 19:43:10 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:43:10 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Successfully detached device vdb from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 from the persistent domain config.
Nov 10 19:43:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:43:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:43:10 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:43:10 user nova-compute[75026]:   <source dev="/dev/sdf"/>
Nov 10 19:43:10 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:43:10 user nova-compute[75026]:   <serial>9ba2222b-7b87-4c11-82d5-ae4feffb7a1c</serial>
Nov 10 19:43:10 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:43:10 user nova-compute[75026]: </disk>
Nov 10 19:43:10 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:43:10 user nova-compute[75026]: INFO nova.compute.manager [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] Took 24.19 seconds to detach 1 volumes for instance.
Nov 10 19:43:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:11 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:43:11 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:43:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:43:11 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Deleted allocations for instance 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a
Nov 10 19:43:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-63ac48b6-2af1-4766-bd8e-409ad8858ce7 tempest-TestVolumeBootPattern-1182723443 tempest-TestVolumeBootPattern-1182723443-project-member] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 26.903s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.158s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:11 user nova-compute[75026]: INFO nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 10 19:43:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "0d0d9ade-9aaa-49d8-bd3f-e6bb79a77d5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:19 user nova-compute[75026]: INFO nova.compute.manager [None req-5002a70a-cbaa-4c06-9798-017792d7f8d8 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Unrescuing
Nov 10 19:43:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5002a70a-cbaa-4c06-9798-017792d7f8d8 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5002a70a-cbaa-4c06-9798-017792d7f8d8 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquired lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5002a70a-cbaa-4c06-9798-017792d7f8d8 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG nova.network.neutron [None req-5002a70a-cbaa-4c06-9798-017792d7f8d8 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Updating instance_info_cache with network_info: [{"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-5002a70a-cbaa-4c06-9798-017792d7f8d8 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Releasing lock "refresh_cache-b6734c90-d9b3-4705-bb7f-5c5df66e0baf" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG nova.objects.instance [None req-5002a70a-cbaa-4c06-9798-017792d7f8d8 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'flavor' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-7ff48725-e63f-4ecb-b558-99e4393a5d53 req-2a6bec04-3063-4afb-92cf-a01a00d4b653 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7ff48725-e63f-4ecb-b558-99e4393a5d53 req-2a6bec04-3063-4afb-92cf-a01a00d4b653 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7ff48725-e63f-4ecb-b558-99e4393a5d53 req-2a6bec04-3063-4afb-92cf-a01a00d4b653 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7ff48725-e63f-4ecb-b558-99e4393a5d53 req-2a6bec04-3063-4afb-92cf-a01a00d4b653 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-7ff48725-e63f-4ecb-b558-99e4393a5d53 req-2a6bec04-3063-4afb-92cf-a01a00d4b653 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:43:19 user nova-compute[75026]: WARNING nova.compute.manager [req-7ff48725-e63f-4ecb-b558-99e4393a5d53 req-2a6bec04-3063-4afb-92cf-a01a00d4b653 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:43:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:20 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance destroyed successfully.
Nov 10 19:43:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-7b5e4d7a-9dce-49dc-8843-9ba4c8c357e8 req-7296c63f-e7f3-4c3d-8fe1-2aa31bebd830 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7b5e4d7a-9dce-49dc-8843-9ba4c8c357e8 req-7296c63f-e7f3-4c3d-8fe1-2aa31bebd830 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7b5e4d7a-9dce-49dc-8843-9ba4c8c357e8 req-7296c63f-e7f3-4c3d-8fe1-2aa31bebd830 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7b5e4d7a-9dce-49dc-8843-9ba4c8c357e8 req-7296c63f-e7f3-4c3d-8fe1-2aa31bebd830 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-7b5e4d7a-9dce-49dc-8843-9ba4c8c357e8 req-7296c63f-e7f3-4c3d-8fe1-2aa31bebd830 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:43:21 user nova-compute[75026]: WARNING nova.compute.manager [req-7b5e4d7a-9dce-49dc-8843-9ba4c8c357e8 req-7296c63f-e7f3-4c3d-8fe1-2aa31bebd830 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:43:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-5002a70a-cbaa-4c06-9798-017792d7f8d8 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:43:23 user nova-compute[75026]: WARNING nova.compute.manager [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:43:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:43:23 user nova-compute[75026]: WARNING nova.compute.manager [req-d8f36ac1-68f5-4536-8047-ce96a53b3bf9 req-960d80e3-6c8c-4b45-bb1b-62d45f428f5f service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:43:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:43:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:43:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:27 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:43:27 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8092MB free_disk=25.088363647460938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Applying migration context for instance 5bf6de24-c6a5-4b68-ad60-7f582463016b as it has an incoming, in-progress migration e5e7a055-f415-420c-a9a3-b6694d810552. Migration status is post-migrating {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 19:43:27 user nova-compute[75026]: INFO nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating resource usage from migration e5e7a055-f415-420c-a9a3-b6694d810552
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b6734c90-d9b3-4705-bb7f-5c5df66e0baf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Migration e5e7a055-f415-420c-a9a3-b6694d810552 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5bf6de24-c6a5-4b68-ad60-7f582463016b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:43:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:43:28 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:43:28 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:43:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:43:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.881s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 is timed out.
Nov 10 19:43:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Successfully detached device vdb from instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3 from the live domain config.
Nov 10 19:43:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxtDPMrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:43:31 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d8eb4f-8546-4537-86f8-ad0192953939]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:43:31 user nova-compute[75026]: No targets found.
Nov 10 19:43:31 user nova-compute[75026]: iSNS:
Nov 10 19:43:31 user nova-compute[75026]: No targets found.
Nov 10 19:43:31 user nova-compute[75026]: STATIC:
Nov 10 19:43:31 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c
Nov 10 19:43:31 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:43:31 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:43:31 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:43:31 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:43:31 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:43:31 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4
Nov 10 19:43:31 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:43:31 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:43:31 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:43:31 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:43:31 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:43:31 user nova-compute[75026]: FIRMWARE:
Nov 10 19:43:31 user nova-compute[75026]: No targets found.
Nov 10 19:43:31 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:43:31 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:43:31 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b17d6a6-95c0-41b7-bc58-11ebf9b7e886]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d354a1-51a0-4251-884a-01051db195f6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:43:31 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:43:31 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:43:31 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:43:31 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:43:31 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:43:31 user nova-compute[75026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c (non-flash)
Nov 10 19:43:31 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:43:31 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed98131090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c'): ({'sdf'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Removing single pathed devices sdf {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddcfa03-7399-4af7-8217-b4c9f86bfc1a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0d5f26-222b-4626-91e1-b35be528f437]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Flushing IO for device /dev/sdf {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026e1d0-4844-4371-89a8-7e218a01b209]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0d7d4e-820a-4734-a59a-b85a71765476]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] SCSI volumes sdf have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db7d570-b557-4f15-940a-5faa8306bff5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8483e8-dec5-44ed-a128-9c4cdab169d8]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c, portal: 172.16.0.220,3260]
Nov 10 19:43:31 user nova-compute[75026]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c, portal: 172.16.0.220,3260] successful.
Nov 10 19:43:31 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba2222b-7b87-4c11-82d5-ae4feffb7a1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55f5c17-8e22-4e34-8956-8c1ae96dc70c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] <== disconnect_volume: return (318ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [{"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-3b2146ef-84d2-4180-bea1-e0df77c56804" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:43:33 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:43:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:43:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:43:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:43:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:43:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Starting finish_migration {{(pid=75026) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance directory exists: not creating {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 19:43:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Creating image(s)
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Did not create local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Ensure instance console log exists: /opt/stack/data/nova/instances/5bf6de24-c6a5-4b68-ad60-7f582463016b/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Start _get_guest_xml network_info=[{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-236681753-network", "vif_mac": "fa:16:3e:bc:60:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'aafae973-89d6-44ea-8ba4-1d8d06913036', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWsJfgjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5bf6de24-c6a5-4b68-ad60-7f582463016b', 'attached_at': '2023-11-10T19:43:35.000000', 'detached_at': '', 'volume_id': '4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'serial': '4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:43:35 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:43:35 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWsJfgjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:43:35 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:43:35 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:43:35 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be49dcd-3e91-4967-afbd-c0f2c93a763c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:43:35 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c928bd5-ecbe-480a-9664-64312b6a295a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee] added
Nov 10 19:43:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccef94ff-a6e9-443b-b2ec-7d11721aa35b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[29089eba-3175-4907-b7ba-a739ee48a665]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWsJfgjF {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWsJfgjF" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9e9cc6-3d39-461d-91bb-5109263afb46]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWsJfgjF'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a93ae3-1721-4535-b450-3aeb44ac40b7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e721c5-563b-4663-a390-8f763c86f3a9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d895a3-11b2-4982-b6ac-680f32366304]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260]
Nov 10 19:43:35 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260] successful.
Nov 10 19:43:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad60d7-db6c-4c4c-a464-377c57278dd7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d379c121-5d16-48f5-8afe-9a487a49cc96]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:43:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:43:35 user nova-compute[75026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:43:35 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2477ef-d958-44d8-babd-ea963f2e5cd9]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:43:35 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWsJfgjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:43:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:43:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26362346537313666', 'path': '/dev/sdd'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:43:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362346537313666', 'path': '/dev/sdd'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1250687212',display_name='tempest-ServerActionsTestOtherA-server-1250687212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1250687212',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:41:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-un001tri',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:43:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=5bf6de24-c6a5-4b68-ad60-7f582463016b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-236681753-network", "vif_mac": "fa:16:3e:bc:60:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-236681753-network", "vif_mac": "fa:16:3e:bc:60:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:43:37 user nova-compute[75026]:   <uuid>5bf6de24-c6a5-4b68-ad60-7f582463016b</uuid>
Nov 10 19:43:37 user nova-compute[75026]:   <name>instance-00000028</name>
Nov 10 19:43:37 user nova-compute[75026]:   <memory>2097152</memory>
Nov 10 19:43:37 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:43:37 user nova-compute[75026]:   <metadata>
Nov 10 19:43:37 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:43:37 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:43:37 user nova-compute[75026]:       <nova:name>tempest-ServerActionsTestOtherA-server-1250687212</nova:name>
Nov 10 19:43:37 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:43:35</nova:creationTime>
Nov 10 19:43:37 user nova-compute[75026]:       <nova:flavor name="m1.small">
Nov 10 19:43:37 user nova-compute[75026]:         <nova:memory>2048</nova:memory>
Nov 10 19:43:37 user nova-compute[75026]:         <nova:disk>20</nova:disk>
Nov 10 19:43:37 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:43:37 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:43:37 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:43:37 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:43:37 user nova-compute[75026]:       <nova:owner>
Nov 10 19:43:37 user nova-compute[75026]:         <nova:user uuid="b4fcc097fff34ad2b2cc532d269e06bb">tempest-ServerActionsTestOtherA-664805234-project-member</nova:user>
Nov 10 19:43:37 user nova-compute[75026]:         <nova:project uuid="cdef98b8144148229b82888b888d88c5">tempest-ServerActionsTestOtherA-664805234</nova:project>
Nov 10 19:43:37 user nova-compute[75026]:       </nova:owner>
Nov 10 19:43:37 user nova-compute[75026]:       <nova:ports>
Nov 10 19:43:37 user nova-compute[75026]:         <nova:port uuid="fc91a2c1-39c8-48ff-bb26-046aa507a18e">
Nov 10 19:43:37 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:43:37 user nova-compute[75026]:         </nova:port>
Nov 10 19:43:37 user nova-compute[75026]:       </nova:ports>
Nov 10 19:43:37 user nova-compute[75026]:     </nova:instance>
Nov 10 19:43:37 user nova-compute[75026]:   </metadata>
Nov 10 19:43:37 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:43:37 user nova-compute[75026]:     <system>
Nov 10 19:43:37 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:43:37 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:43:37 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:43:37 user nova-compute[75026]:       <entry name="serial">5bf6de24-c6a5-4b68-ad60-7f582463016b</entry>
Nov 10 19:43:37 user nova-compute[75026]:       <entry name="uuid">5bf6de24-c6a5-4b68-ad60-7f582463016b</entry>
Nov 10 19:43:37 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:43:37 user nova-compute[75026]:     </system>
Nov 10 19:43:37 user nova-compute[75026]:   </sysinfo>
Nov 10 19:43:37 user nova-compute[75026]:   <os>
Nov 10 19:43:37 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:43:37 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:43:37 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:43:37 user nova-compute[75026]:   </os>
Nov 10 19:43:37 user nova-compute[75026]:   <features>
Nov 10 19:43:37 user nova-compute[75026]:     <acpi/>
Nov 10 19:43:37 user nova-compute[75026]:     <apic/>
Nov 10 19:43:37 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:43:37 user nova-compute[75026]:   </features>
Nov 10 19:43:37 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:43:37 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:43:37 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:43:37 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:43:37 user nova-compute[75026]:   </clock>
Nov 10 19:43:37 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:43:37 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:43:37 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:43:37 user nova-compute[75026]:   </cpu>
Nov 10 19:43:37 user nova-compute[75026]:   <devices>
Nov 10 19:43:37 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:43:37 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:43:37 user nova-compute[75026]:       <source dev="/dev/sdd"/>
Nov 10 19:43:37 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:43:37 user nova-compute[75026]:       <serial>4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee</serial>
Nov 10 19:43:37 user nova-compute[75026]:     </disk>
Nov 10 19:43:37 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:43:37 user nova-compute[75026]:       <mac address="fa:16:3e:bc:60:f8"/>
Nov 10 19:43:37 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:43:37 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:43:37 user nova-compute[75026]:       <target dev="tapfc91a2c1-39"/>
Nov 10 19:43:37 user nova-compute[75026]:     </interface>
Nov 10 19:43:37 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:43:37 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/5bf6de24-c6a5-4b68-ad60-7f582463016b/console.log" append="off"/>
Nov 10 19:43:37 user nova-compute[75026]:     </serial>
Nov 10 19:43:37 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:43:37 user nova-compute[75026]:     <video>
Nov 10 19:43:37 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:43:37 user nova-compute[75026]:     </video>
Nov 10 19:43:37 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:43:37 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:43:37 user nova-compute[75026]:     </rng>
Nov 10 19:43:37 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:43:37 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:43:37 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:43:37 user nova-compute[75026]:     </memballoon>
Nov 10 19:43:37 user nova-compute[75026]:   </devices>
Nov 10 19:43:37 user nova-compute[75026]: </domain>
Nov 10 19:43:37 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1250687212',display_name='tempest-ServerActionsTestOtherA-server-1250687212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1250687212',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:41:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-un001tri',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:43:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=5bf6de24-c6a5-4b68-ad60-7f582463016b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-236681753-network", "vif_mac": "fa:16:3e:bc:60:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-236681753-network", "vif_mac": "fa:16:3e:bc:60:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG os_vif [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7c8f527-d647-5e73-a474-44f2649aa092', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc91a2c1-39, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc91a2c1-39, col_values=(('qos', UUID('8aeb7167-5dff-4070-a1a4-51cf0dd75d9d')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc91a2c1-39, col_values=(('external_ids', {'iface-id': 'fc91a2c1-39c8-48ff-bb26-046aa507a18e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:60:f8', 'vm-uuid': '5bf6de24-c6a5-4b68-ad60-7f582463016b'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:37 user nova-compute[75026]: INFO os_vif [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39')
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:43:37 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] No VIF found with MAC fa:16:3e:bc:60:f8, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG nova.objects.instance [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lazy-loading 'flavor' on Instance uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-322bd289-7d0c-4ee4-86f1-d58c254c0650 tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.155s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-f303af78-d51b-462d-a280-f240c179fc9b req-3d654062-7e0b-4bd6-839a-69be23bf2009 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f303af78-d51b-462d-a280-f240c179fc9b req-3d654062-7e0b-4bd6-839a-69be23bf2009 service nova] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f303af78-d51b-462d-a280-f240c179fc9b req-3d654062-7e0b-4bd6-839a-69be23bf2009 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f303af78-d51b-462d-a280-f240c179fc9b req-3d654062-7e0b-4bd6-839a-69be23bf2009 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-f303af78-d51b-462d-a280-f240c179fc9b req-3d654062-7e0b-4bd6-839a-69be23bf2009 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] No waiting events found dispatching network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:43:38 user nova-compute[75026]: WARNING nova.compute.manager [req-f303af78-d51b-462d-a280-f240c179fc9b req-3d654062-7e0b-4bd6-839a-69be23bf2009 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received unexpected event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e for instance with vm_state active and task_state resize_finish.
Nov 10 19:43:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:43:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance running successfully.
Nov 10 19:43:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Failed to set time: agent not configured {{(pid=75026) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 19:43:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-330d7b39-a53c-4003-bfc7-3c85ff57ac93 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] finish_migration finished successfully. {{(pid=75026) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 19:43:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-f85fdaab-c135-4662-9f2a-009bf547b45b req-3fa85ac7-ddb0-4cf8-8f84-ae08cf65c4d5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:43:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f85fdaab-c135-4662-9f2a-009bf547b45b req-3fa85ac7-ddb0-4cf8-8f84-ae08cf65c4d5 service nova] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:43:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f85fdaab-c135-4662-9f2a-009bf547b45b req-3fa85ac7-ddb0-4cf8-8f84-ae08cf65c4d5 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:43:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f85fdaab-c135-4662-9f2a-009bf547b45b req-3fa85ac7-ddb0-4cf8-8f84-ae08cf65c4d5 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:43:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-f85fdaab-c135-4662-9f2a-009bf547b45b req-3fa85ac7-ddb0-4cf8-8f84-ae08cf65c4d5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] No waiting events found dispatching network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:43:40 user nova-compute[75026]: WARNING nova.compute.manager [req-f85fdaab-c135-4662-9f2a-009bf547b45b req-3fa85ac7-ddb0-4cf8-8f84-ae08cf65c4d5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received unexpected event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e for instance with vm_state active and task_state resize_finish.
Nov 10 19:43:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:43:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:01 user nova-compute[75026]: INFO nova.compute.manager [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Terminating instance
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-0af5d5a9-ca3a-40fc-af55-1ef8e1b24d7a req-a79f33cf-11bc-42d3-9478-6bf2734e51f2 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received event network-vif-unplugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0af5d5a9-ca3a-40fc-af55-1ef8e1b24d7a req-a79f33cf-11bc-42d3-9478-6bf2734e51f2 service nova] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0af5d5a9-ca3a-40fc-af55-1ef8e1b24d7a req-a79f33cf-11bc-42d3-9478-6bf2734e51f2 service nova] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0af5d5a9-ca3a-40fc-af55-1ef8e1b24d7a req-a79f33cf-11bc-42d3-9478-6bf2734e51f2 service nova] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-0af5d5a9-ca3a-40fc-af55-1ef8e1b24d7a req-a79f33cf-11bc-42d3-9478-6bf2734e51f2 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] No waiting events found dispatching network-vif-unplugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-0af5d5a9-ca3a-40fc-af55-1ef8e1b24d7a req-a79f33cf-11bc-42d3-9478-6bf2734e51f2 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received event network-vif-unplugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:44:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Instance destroyed successfully.
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.objects.instance [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lazy-loading 'resources' on Instance uuid e16d4fd8-931a-43b2-aca8-45b6c2b571a3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:38:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-770123529',display_name='tempest-TestServerVolumeAttachmentScenario-server-770123529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-770123529',id=36,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvMILOkHszM+kMMCQrOX6JeeQsCXqVWh4wODtwh1G6yAIZBKQknxWtlQmClNSch4AA3f9vMjSFa8YfExaJDIlh02/osZdI7GVTAzq/4RyI4FEgQhg2oaoJLCfOx9CIdUw==',key_name='tempest-keypair-569313212',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:38:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f18a8d5506ea4c5397e100334afb623c',ramdisk_id='',reservation_id='r-o0lyeqe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-382703458',owner_user_name='tempest-TestServerVolumeAttachmentScenario-382703458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:38:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442ec391b55f49fd8bf04a9a4d175557',uuid=e16d4fd8-931a-43b2-aca8-45b6c2b571a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Converting VIF {"id": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "address": "fa:16:3e:d2:2e:9f", "network": {"id": "1da42e85-0296-44df-ab02-3eea80ea01dc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2018016995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f18a8d5506ea4c5397e100334afb623c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d44a002-8e", "ovs_interfaceid": "9d44a002-8ee9-4be7-b437-cf08ff9119d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=9d44a002-8ee9-4be7-b437-cf08ff9119d7,network=Network(1da42e85-0296-44df-ab02-3eea80ea01dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d44a002-8e') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG os_vif [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=9d44a002-8ee9-4be7-b437-cf08ff9119d7,network=Network(1da42e85-0296-44df-ab02-3eea80ea01dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d44a002-8e') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d44a002-8e, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2897c995-e2ec-43a7-97d2-ad3c02ad515b) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:01 user nova-compute[75026]: INFO os_vif [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2e:9f,bridge_name='br-int',has_traffic_filtering=True,id=9d44a002-8ee9-4be7-b437-cf08ff9119d7,network=Network(1da42e85-0296-44df-ab02-3eea80ea01dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d44a002-8e')
Nov 10 19:44:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Deleting instance files /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3_del
Nov 10 19:44:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Deletion of /opt/stack/data/nova/instances/e16d4fd8-931a-43b2-aca8-45b6c2b571a3_del complete
Nov 10 19:44:01 user nova-compute[75026]: INFO nova.compute.manager [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 19:44:01 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:44:01 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:44:02 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:44:02 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Took 0.76 seconds to deallocate network for instance.
Nov 10 19:44:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-6d5fa188-2d2c-44ac-b2ab-4e6aaf7b2069 req-f054681c-1786-4eea-8e14-523d0ade4a1e service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received event network-vif-deleted-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:44:03 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:44:03 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:44:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:03 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Deleted allocations for instance e16d4fd8-931a-43b2-aca8-45b6c2b571a3
Nov 10 19:44:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-9744674e-dd2c-48d8-89f7-0948aaea66e5 req-3aab3c9d-39a7-41bc-8b74-50ef92ede5b3 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received event network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:44:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9744674e-dd2c-48d8-89f7-0948aaea66e5 req-3aab3c9d-39a7-41bc-8b74-50ef92ede5b3 service nova] Acquiring lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9744674e-dd2c-48d8-89f7-0948aaea66e5 req-3aab3c9d-39a7-41bc-8b74-50ef92ede5b3 service nova] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9744674e-dd2c-48d8-89f7-0948aaea66e5 req-3aab3c9d-39a7-41bc-8b74-50ef92ede5b3 service nova] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-9744674e-dd2c-48d8-89f7-0948aaea66e5 req-3aab3c9d-39a7-41bc-8b74-50ef92ede5b3 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] No waiting events found dispatching network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:44:03 user nova-compute[75026]: WARNING nova.compute.manager [req-9744674e-dd2c-48d8-89f7-0948aaea66e5 req-3aab3c9d-39a7-41bc-8b74-50ef92ede5b3 service nova] [instance: e16d4fd8-931a-43b2-aca8-45b6c2b571a3] Received unexpected event network-vif-plugged-9d44a002-8ee9-4be7-b437-cf08ff9119d7 for instance with vm_state deleted and task_state None.
Nov 10 19:44:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-739cbd29-0a7d-475a-912b-0a60588b319b tempest-TestServerVolumeAttachmentScenario-382703458 tempest-TestServerVolumeAttachmentScenario-382703458-project-member] Lock "e16d4fd8-931a-43b2-aca8-45b6c2b571a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.398s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:44:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:44:23 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:44:24 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:44:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:44:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:44:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8033MB free_disk=25.112834930419922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Applying migration context for instance 5bf6de24-c6a5-4b68-ad60-7f582463016b as it has an incoming, in-progress migration e5e7a055-f415-420c-a9a3-b6694d810552. Migration status is finished {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 19:44:26 user nova-compute[75026]: INFO nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating resource usage from migration e5e7a055-f415-420c-a9a3-b6694d810552
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b6734c90-d9b3-4705-bb7f-5c5df66e0baf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Migration e5e7a055-f415-420c-a9a3-b6694d810552 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5bf6de24-c6a5-4b68-ad60-7f582463016b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:44:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:44:27 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:44:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:44:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:44:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Updating instance_info_cache with network_info: [{"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-468562be-d411-4da2-bf90-7cb2b1edacca" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:44:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:44:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:44:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:44:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:44:33 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:44:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-6a0b9863-6ed3-4ffd-8b14-619c3ae60638 req-ca7a8faa-02f2-49a8-a6f3-a5e6a669437f service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-6a0b9863-6ed3-4ffd-8b14-619c3ae60638 req-ca7a8faa-02f2-49a8-a6f3-a5e6a669437f service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing instance network info cache due to event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6a0b9863-6ed3-4ffd-8b14-619c3ae60638 req-ca7a8faa-02f2-49a8-a6f3-a5e6a669437f service nova] Acquiring lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6a0b9863-6ed3-4ffd-8b14-619c3ae60638 req-ca7a8faa-02f2-49a8-a6f3-a5e6a669437f service nova] Acquired lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-6a0b9863-6ed3-4ffd-8b14-619c3ae60638 req-ca7a8faa-02f2-49a8-a6f3-a5e6a669437f service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-6a0b9863-6ed3-4ffd-8b14-619c3ae60638 req-ca7a8faa-02f2-49a8-a6f3-a5e6a669437f service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updated VIF entry in instance network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG nova.network.neutron [req-6a0b9863-6ed3-4ffd-8b14-619c3ae60638 req-ca7a8faa-02f2-49a8-a6f3-a5e6a669437f service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:44:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6a0b9863-6ed3-4ffd-8b14-619c3ae60638 req-ca7a8faa-02f2-49a8-a6f3-a5e6a669437f service nova] Releasing lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-11f28d44-0343-477e-ae6b-f2a1a41254c9 req-a338f9bc-e239-4f9e-b396-34f4f0d2902a service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-11f28d44-0343-477e-ae6b-f2a1a41254c9 req-a338f9bc-e239-4f9e-b396-34f4f0d2902a service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing instance network info cache due to event network-changed-11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-11f28d44-0343-477e-ae6b-f2a1a41254c9 req-a338f9bc-e239-4f9e-b396-34f4f0d2902a service nova] Acquiring lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-11f28d44-0343-477e-ae6b-f2a1a41254c9 req-a338f9bc-e239-4f9e-b396-34f4f0d2902a service nova] Acquired lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-11f28d44-0343-477e-ae6b-f2a1a41254c9 req-a338f9bc-e239-4f9e-b396-34f4f0d2902a service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Refreshing network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:43 user nova-compute[75026]: INFO nova.compute.manager [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Detaching volume afc4a073-7103-465b-92df-ebe7d42ac1b4
Nov 10 19:44:43 user nova-compute[75026]: INFO nova.virt.block_device [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Attempting to driver detach volume afc4a073-7103-465b-92df-ebe7d42ac1b4 from mountpoint /dev/vdb
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Attempting to detach device vdb from instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:44:43 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:44:43 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:44:43 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:44:43 user nova-compute[75026]:   <serial>afc4a073-7103-465b-92df-ebe7d42ac1b4</serial>
Nov 10 19:44:43 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 19:44:43 user nova-compute[75026]: </disk>
Nov 10 19:44:43 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:44:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully detached device vdb from instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 from the persistent domain config.
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:44:43 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:44:43 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:44:43 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:44:43 user nova-compute[75026]:   <serial>afc4a073-7103-465b-92df-ebe7d42ac1b4</serial>
Nov 10 19:44:43 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 19:44:43 user nova-compute[75026]: </disk>
Nov 10 19:44:43 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-11f28d44-0343-477e-ae6b-f2a1a41254c9 req-a338f9bc-e239-4f9e-b396-34f4f0d2902a service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updated VIF entry in instance network info cache for port 11d38f14-6245-494b-b6c1-a80f36322ded. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.network.neutron [req-11f28d44-0343-477e-ae6b-f2a1a41254c9 req-a338f9bc-e239-4f9e-b396-34f4f0d2902a service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-11f28d44-0343-477e-ae6b-f2a1a41254c9 req-a338f9bc-e239-4f9e-b396-34f4f0d2902a service nova] Releasing lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:44:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:44:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.003s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Going to confirm migration 2 {{(pid=75026) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquired lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'info_cache' on Instance uuid 5bf6de24-c6a5-4b68-ad60-7f582463016b {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating instance_info_cache with network_info: [{"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Releasing lock "refresh_cache-5bf6de24-c6a5-4b68-ad60-7f582463016b" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'migration_context' on Instance uuid 5bf6de24-c6a5-4b68-ad60-7f582463016b {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG nova.objects.base [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Object Instance<5bf6de24-c6a5-4b68-ad60-7f582463016b> lazy-loaded attributes: info_cache,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:44:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:44:48 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:44:48 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:44:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.400s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:48 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Deleted allocation for migration e5e7a055-f415-420c-a9a3-b6694d810552
Nov 10 19:44:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4e381087-56b4-4a2c-bea6-f891590307f7 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.501s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:44:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:44:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:45:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:45:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:45:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 is timed out.
Nov 10 19:45:03 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully detached device vdb from instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 from the live domain config.
Nov 10 19:45:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LyoRqUME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:45:03 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[20868653-2434-482b-82bd-a15825fbb80a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:45:03 user nova-compute[75026]: No targets found.
Nov 10 19:45:03 user nova-compute[75026]: iSNS:
Nov 10 19:45:03 user nova-compute[75026]: No targets found.
Nov 10 19:45:03 user nova-compute[75026]: STATIC:
Nov 10 19:45:03 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:45:03 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:45:03 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:45:03 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4
Nov 10 19:45:03 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:45:03 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:45:03 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:45:03 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:45:03 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:45:03 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee
Nov 10 19:45:03 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:45:03 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:45:03 user nova-compute[75026]: FIRMWARE:
Nov 10 19:45:03 user nova-compute[75026]: No targets found.
Nov 10 19:45:03 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:45:03 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:45:03 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed67892e-2f1f-4d5c-95f9-5a9da4c99972]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db70930-a38e-439f-b0b6-898acc539064]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:45:03 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:45:03 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:45:03 user nova-compute[75026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:45:03 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:45:03 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:45:03 user nova-compute[75026]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 (non-flash)
Nov 10 19:45:03 user nova-compute[75026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:45:03 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed8020c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[54043660-d42d-44be-99ad-66334db4078a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6796f74c-32fd-4cf1-9c83-f4ae16eb71fa]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[190eefcf-1c99-4f10-81ec-53e0884f9e60]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a00dd0e-5ed5-408c-8fac-dff374cf179d]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:45:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14310c02-e342-4a7a-b457-b93c16905824]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[165939c4-aed9-4278-870c-0306ec55680f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260]
Nov 10 19:45:04 user nova-compute[75026]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4, portal: 172.16.0.220,3260] successful.
Nov 10 19:45:04 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc4a073-7103-465b-92df-ebe7d42ac1b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e2bf7-9363-4448-b9e4-8036636f7629]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] <== disconnect_volume: return (299ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:45:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:45:05 user nova-compute[75026]: DEBUG nova.objects.instance [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'flavor' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:45:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-7906a3e9-bfaa-4315-b987-4795725cc8b6 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.889s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:45:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:45:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:45:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:45:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:45:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:45:09 user nova-compute[75026]: INFO nova.compute.manager [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Terminating instance
Nov 10 19:45:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:45:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-0c7d33af-5dfe-4466-bdd8-3d1f433c15ce req-77ffa81e-00c5-4870-9d65-25cbb11657b0 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0c7d33af-5dfe-4466-bdd8-3d1f433c15ce req-77ffa81e-00c5-4870-9d65-25cbb11657b0 service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0c7d33af-5dfe-4466-bdd8-3d1f433c15ce req-77ffa81e-00c5-4870-9d65-25cbb11657b0 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0c7d33af-5dfe-4466-bdd8-3d1f433c15ce req-77ffa81e-00c5-4870-9d65-25cbb11657b0 service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-0c7d33af-5dfe-4466-bdd8-3d1f433c15ce req-77ffa81e-00c5-4870-9d65-25cbb11657b0 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-0c7d33af-5dfe-4466-bdd8-3d1f433c15ce req-77ffa81e-00c5-4870-9d65-25cbb11657b0 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-unplugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Instance destroyed successfully.
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'resources' on Instance uuid b6734c90-d9b3-4705-bb7f-5c5df66e0baf {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-591311641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-591311641',id=37,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:41:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-d4fcplpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:43:24Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=b6734c90-d9b3-4705-bb7f-5c5df66e0baf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "address": "fa:16:3e:c8:79:7e", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38091bf6-30", "ovs_interfaceid": "38091bf6-30e8-4cb1-8aa6-ccf0d388b584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=38091bf6-30e8-4cb1-8aa6-ccf0d388b584,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38091bf6-30') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_vif [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=38091bf6-30e8-4cb1-8aa6-ccf0d388b584,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38091bf6-30') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38091bf6-30, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9623f2d1-5ab8-4090-a68b-3f3c6a3e183e) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:10 user nova-compute[75026]: INFO os_vif [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:79:7e,bridge_name='br-int',has_traffic_filtering=True,id=38091bf6-30e8-4cb1-8aa6-ccf0d388b584,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38091bf6-30')
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpjVgYPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:45:10 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40697b3-0d10-4955-aa02-369497c6667d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:45:10 user nova-compute[75026]: No targets found.
Nov 10 19:45:10 user nova-compute[75026]: iSNS:
Nov 10 19:45:10 user nova-compute[75026]: No targets found.
Nov 10 19:45:10 user nova-compute[75026]: STATIC:
Nov 10 19:45:10 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6
Nov 10 19:45:10 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:45:10 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:45:10 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:45:10 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:45:10 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:45:10 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee
Nov 10 19:45:10 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:45:10 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:45:10 user nova-compute[75026]: FIRMWARE:
Nov 10 19:45:10 user nova-compute[75026]: No targets found.
Nov 10 19:45:10 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:45:10 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:45:10 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8829efdf-3c12-4112-983a-9f71f1e21664]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd026a6-1d78-4cfc-87e9-9f94030d4322]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:45:10 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:45:10 user nova-compute[75026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:45:10 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:45:10 user nova-compute[75026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 (non-flash)
Nov 10 19:45:10 user nova-compute[75026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:45:10 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda050d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e26a4-e5f8-4d57-a85c-1117533a7abf]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f233152-2ac5-484d-99d2-5692cdcb9453]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f961a50-ee88-4c05-9e20-be8d686e0160]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda3fac4-99be-424e-be74-2949c8e5553d]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_44abb5db',) {{(pid=86097) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef81a26-31a8-40f6-b6e9-390513726b49]: (4, None) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5ec84-f488-43cb-99fd-0a2335150c1d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91bd9f1-2298-4bd5-8e8f-d333150105e8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6, portal: 172.16.0.220,3260]
Nov 10 19:45:10 user nova-compute[75026]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6, portal: 172.16.0.220,3260] successful.
Nov 10 19:45:10 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1f6d1d-e407-44d4-ad38-b1de9f8845a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ae4c8-ac26-48c7-af45-58e6668d3aa8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] <== disconnect_volume: return (312ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:45:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:45:10 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Deleting instance files /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf_del
Nov 10 19:45:10 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Deletion of /opt/stack/data/nova/instances/b6734c90-d9b3-4705-bb7f-5c5df66e0baf_del complete
Nov 10 19:45:11 user nova-compute[75026]: INFO nova.compute.manager [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 10 19:45:11 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:45:11 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:45:11 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:45:11 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:45:11 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Took 0.51 seconds to deallocate network for instance.
Nov 10 19:45:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-b6082f83-7aa5-475e-ae2d-c3b201fe2902 req-ffdb35f2-b35e-4b72-95f5-d29ea9239543 service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-deleted-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-c4744505-5323-44cc-b88e-881d24e018e5 req-d676e585-84b8-4374-9ee0-c88ed16822ec service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c4744505-5323-44cc-b88e-881d24e018e5 req-d676e585-84b8-4374-9ee0-c88ed16822ec service nova] Acquiring lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c4744505-5323-44cc-b88e-881d24e018e5 req-d676e585-84b8-4374-9ee0-c88ed16822ec service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c4744505-5323-44cc-b88e-881d24e018e5 req-d676e585-84b8-4374-9ee0-c88ed16822ec service nova] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-c4744505-5323-44cc-b88e-881d24e018e5 req-d676e585-84b8-4374-9ee0-c88ed16822ec service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] No waiting events found dispatching network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:45:12 user nova-compute[75026]: WARNING nova.compute.manager [req-c4744505-5323-44cc-b88e-881d24e018e5 req-d676e585-84b8-4374-9ee0-c88ed16822ec service nova] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Received unexpected event network-vif-plugged-38091bf6-30e8-4cb1-8aa6-ccf0d388b584 for instance with vm_state active and task_state deleting.
Nov 10 19:45:12 user nova-compute[75026]: INFO nova.compute.manager [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b6734c90-d9b3-4705-bb7f-5c5df66e0baf] Took 0.96 seconds to detach 1 volumes for instance.
Nov 10 19:45:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:45:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:45:12 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Deleted allocations for instance b6734c90-d9b3-4705-bb7f-5c5df66e0baf
Nov 10 19:45:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b76e99c1-c116-40ca-bce9-199cfee7c80e tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b6734c90-d9b3-4705-bb7f-5c5df66e0baf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.186s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:45:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:45:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:45:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:45:25 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:45:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:45:27 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:45:27 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=25.102508544921875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 468562be-d411-4da2-bf90-7cb2b1edacca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 352c397d-7e92-4b2c-8e4a-9482c4b74326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5bf6de24-c6a5-4b68-ad60-7f582463016b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:45:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:45:28 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:45:28 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:45:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:45:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [{"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-352c397d-7e92-4b2c-8e4a-9482c4b74326" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:45:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:45:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:45:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:45:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "468562be-d411-4da2-bf90-7cb2b1edacca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:00 user nova-compute[75026]: INFO nova.compute.manager [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Terminating instance
Nov 10 19:46:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:46:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-0f5e8a11-ba76-4e30-8ddf-2c8b3b33a0fd req-e94b4d4d-b655-4be5-ba4b-38f1973644cf service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-unplugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0f5e8a11-ba76-4e30-8ddf-2c8b3b33a0fd req-e94b4d4d-b655-4be5-ba4b-38f1973644cf service nova] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0f5e8a11-ba76-4e30-8ddf-2c8b3b33a0fd req-e94b4d4d-b655-4be5-ba4b-38f1973644cf service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0f5e8a11-ba76-4e30-8ddf-2c8b3b33a0fd req-e94b4d4d-b655-4be5-ba4b-38f1973644cf service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-0f5e8a11-ba76-4e30-8ddf-2c8b3b33a0fd req-e94b4d4d-b655-4be5-ba4b-38f1973644cf service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] No waiting events found dispatching network-vif-unplugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.compute.manager [req-0f5e8a11-ba76-4e30-8ddf-2c8b3b33a0fd req-e94b4d4d-b655-4be5-ba4b-38f1973644cf service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-unplugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Instance destroyed successfully.
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'resources' on Instance uuid 468562be-d411-4da2-bf90-7cb2b1edacca {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-752617559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-752617559',id=34,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-06msk51f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:37:44Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=468562be-d411-4da2-bf90-7cb2b1edacca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "address": "fa:16:3e:11:28:35", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4734a-85", "ovs_interfaceid": "3de4734a-85d3-455d-a53d-a30e9bea20c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:28:35,bridge_name='br-int',has_traffic_filtering=True,id=3de4734a-85d3-455d-a53d-a30e9bea20c2,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4734a-85') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG os_vif [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:28:35,bridge_name='br-int',has_traffic_filtering=True,id=3de4734a-85d3-455d-a53d-a30e9bea20c2,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4734a-85') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de4734a-85, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bb0aee7-cf18-4465-a7bf-3dde0dfc4ea2) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:01 user nova-compute[75026]: INFO os_vif [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:28:35,bridge_name='br-int',has_traffic_filtering=True,id=3de4734a-85d3-455d-a53d-a30e9bea20c2,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4734a-85')
Nov 10 19:46:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Deleting instance files /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca_del
Nov 10 19:46:01 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Deletion of /opt/stack/data/nova/instances/468562be-d411-4da2-bf90-7cb2b1edacca_del complete
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: INFO nova.compute.manager [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 19:46:01 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:02 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:46:02 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Took 0.45 seconds to deallocate network for instance.
Nov 10 19:46:02 user nova-compute[75026]: DEBUG nova.compute.manager [req-6dbcdcdb-76a3-4072-9020-ec0e91c2e3fd req-55a2a06a-077a-4f9f-89df-76f26c3970bc service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-deleted-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:02 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:46:02 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:46:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:02 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Deleted allocations for instance 468562be-d411-4da2-bf90-7cb2b1edacca
Nov 10 19:46:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c9d379a3-abef-4e90-9eb6-b269c97449ac tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "468562be-d411-4da2-bf90-7cb2b1edacca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] No waiting events found dispatching network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:03 user nova-compute[75026]: WARNING nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received unexpected event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 for instance with vm_state deleted and task_state None.
Nov 10 19:46:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] No waiting events found dispatching network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:03 user nova-compute[75026]: WARNING nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received unexpected event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 for instance with vm_state deleted and task_state None.
Nov 10 19:46:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] No waiting events found dispatching network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:03 user nova-compute[75026]: WARNING nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received unexpected event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 for instance with vm_state deleted and task_state None.
Nov 10 19:46:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Acquiring lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] Lock "468562be-d411-4da2-bf90-7cb2b1edacca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] No waiting events found dispatching network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:03 user nova-compute[75026]: WARNING nova.compute.manager [req-729debd1-ab59-4bc7-a5be-551461c94ef4 req-4b10cced-c2da-449e-be08-827d8d4fdc13 service nova] [instance: 468562be-d411-4da2-bf90-7cb2b1edacca] Received unexpected event network-vif-plugged-3de4734a-85d3-455d-a53d-a30e9bea20c2 for instance with vm_state deleted and task_state None.
Nov 10 19:46:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:10 user nova-compute[75026]: INFO nova.compute.manager [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Terminating instance
Nov 10 19:46:10 user nova-compute[75026]: DEBUG nova.compute.manager [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-160efda7-d9b4-4e59-a00d-7c28d20e2db0 req-5034983e-5849-43fb-bfe7-9a955428f3c3 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-unplugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-160efda7-d9b4-4e59-a00d-7c28d20e2db0 req-5034983e-5849-43fb-bfe7-9a955428f3c3 service nova] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-160efda7-d9b4-4e59-a00d-7c28d20e2db0 req-5034983e-5849-43fb-bfe7-9a955428f3c3 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-160efda7-d9b4-4e59-a00d-7c28d20e2db0 req-5034983e-5849-43fb-bfe7-9a955428f3c3 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-160efda7-d9b4-4e59-a00d-7c28d20e2db0 req-5034983e-5849-43fb-bfe7-9a955428f3c3 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] No waiting events found dispatching network-vif-unplugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.compute.manager [req-160efda7-d9b4-4e59-a00d-7c28d20e2db0 req-5034983e-5849-43fb-bfe7-9a955428f3c3 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-unplugged-11d38f14-6245-494b-b6c1-a80f36322ded for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Instance destroyed successfully.
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.objects.instance [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'resources' on Instance uuid 352c397d-7e92-4b2c-8e4a-9482c4b74326 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-697677391',display_name='tempest-TestMinimumBasicScenario-server-697677391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-697677391',id=38,image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9iJhoV2AQmlb4E4tOUu9pK1P1y6TbuVhEZHslkEnMBCG7TKJFJgekMxSamW7Co3bXviUcXuGTmeD65Hic4t5VK0PflhuWDH2hlMRNB1YnAgAuReT6a+kjcydoJxWNbyg==',key_name='tempest-TestMinimumBasicScenario-1209618325',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:39:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-3yzzzsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='201ce38e-7d35-40dd-97ac-e4300b00561a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:42:58Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=352c397d-7e92-4b2c-8e4a-9482c4b74326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "11d38f14-6245-494b-b6c1-a80f36322ded", "address": "fa:16:3e:03:c4:a6", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d38f14-62", "ovs_interfaceid": "11d38f14-6245-494b-b6c1-a80f36322ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG os_vif [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11d38f14-62, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46a1640e-a9dd-49a2-abae-fcf6eeea8e98) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:11 user nova-compute[75026]: INFO os_vif [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:c4:a6,bridge_name='br-int',has_traffic_filtering=True,id=11d38f14-6245-494b-b6c1-a80f36322ded,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d38f14-62')
Nov 10 19:46:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Deleting instance files /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326_del
Nov 10 19:46:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Deletion of /opt/stack/data/nova/instances/352c397d-7e92-4b2c-8e4a-9482c4b74326_del complete
Nov 10 19:46:11 user nova-compute[75026]: INFO nova.compute.manager [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 19:46:11 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:46:11 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:46:12 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:46:12 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Took 0.42 seconds to deallocate network for instance.
Nov 10 19:46:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:12 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:46:12 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:46:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:12 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Deleted allocations for instance 352c397d-7e92-4b2c-8e4a-9482c4b74326
Nov 10 19:46:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-255f518d-cda6-4b5e-8fca-04ea3aa17aaf tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.789s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-4d2d2089-c0d7-4174-96b9-78f0b1f78fae req-c0e62354-9381-40e1-9df5-242f9294fbc7 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4d2d2089-c0d7-4174-96b9-78f0b1f78fae req-c0e62354-9381-40e1-9df5-242f9294fbc7 service nova] Acquiring lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4d2d2089-c0d7-4174-96b9-78f0b1f78fae req-c0e62354-9381-40e1-9df5-242f9294fbc7 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4d2d2089-c0d7-4174-96b9-78f0b1f78fae req-c0e62354-9381-40e1-9df5-242f9294fbc7 service nova] Lock "352c397d-7e92-4b2c-8e4a-9482c4b74326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-4d2d2089-c0d7-4174-96b9-78f0b1f78fae req-c0e62354-9381-40e1-9df5-242f9294fbc7 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] No waiting events found dispatching network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:13 user nova-compute[75026]: WARNING nova.compute.manager [req-4d2d2089-c0d7-4174-96b9-78f0b1f78fae req-c0e62354-9381-40e1-9df5-242f9294fbc7 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received unexpected event network-vif-plugged-11d38f14-6245-494b-b6c1-a80f36322ded for instance with vm_state deleted and task_state None.
Nov 10 19:46:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-4d2d2089-c0d7-4174-96b9-78f0b1f78fae req-c0e62354-9381-40e1-9df5-242f9294fbc7 service nova] [instance: 352c397d-7e92-4b2c-8e4a-9482c4b74326] Received event network-vif-deleted-11d38f14-6245-494b-b6c1-a80f36322ded {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:24 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:26 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:46:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:46:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:46:28 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:46:28 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=25.25323486328125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5bf6de24-c6a5-4b68-ad60-7f582463016b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:46:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:46:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:46:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:46:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:46:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:46:30 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid b9e39b1a-3119-456e-b16d-192dbcd66ae3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:46:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updating instance_info_cache with network_info: [{"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:46:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-b9e39b1a-3119-456e-b16d-192dbcd66ae3" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:46:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:46:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:46:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:46:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:38 user nova-compute[75026]: INFO nova.compute.manager [None req-afe78d02-f0c1-40af-971e-9d4f2dc6a8b4 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Get console output
Nov 10 19:46:38 user nova-compute[75026]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 10 19:46:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:51 user nova-compute[75026]: INFO nova.compute.manager [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Terminating instance
Nov 10 19:46:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-c7b8fd08-e3d3-484e-8cd0-1543bb0a101a req-ec949f16-d223-4258-a7bb-01311125ead6 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c7b8fd08-e3d3-484e-8cd0-1543bb0a101a req-ec949f16-d223-4258-a7bb-01311125ead6 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c7b8fd08-e3d3-484e-8cd0-1543bb0a101a req-ec949f16-d223-4258-a7bb-01311125ead6 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c7b8fd08-e3d3-484e-8cd0-1543bb0a101a req-ec949f16-d223-4258-a7bb-01311125ead6 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-c7b8fd08-e3d3-484e-8cd0-1543bb0a101a req-ec949f16-d223-4258-a7bb-01311125ead6 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-c7b8fd08-e3d3-484e-8cd0-1543bb0a101a req-ec949f16-d223-4258-a7bb-01311125ead6 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-unplugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Instance destroyed successfully.
Nov 10 19:46:52 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'resources' on Instance uuid 3b2146ef-84d2-4180-bea1-e0df77c56804 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-356811107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-356811107',id=23,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-ll4c8m2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:34:00Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=3b2146ef-84d2-4180-bea1-e0df77c56804,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "address": "fa:16:3e:fe:af:dc", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927b3f92-a9", "ovs_interfaceid": "927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:af:dc,bridge_name='br-int',has_traffic_filtering=True,id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927b3f92-a9') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_vif [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:af:dc,bridge_name='br-int',has_traffic_filtering=True,id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927b3f92-a9') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap927b3f92-a9, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9422e998-914d-494c-abae-843e438a0e70) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:46:52 user nova-compute[75026]: INFO os_vif [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:af:dc,bridge_name='br-int',has_traffic_filtering=True,id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927b3f92-a9')
Nov 10 19:46:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnezwMif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:46:52 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c258e85d-7f71-44e8-beda-69b04b69ec1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:46:52 user nova-compute[75026]: No targets found.
Nov 10 19:46:52 user nova-compute[75026]: iSNS:
Nov 10 19:46:52 user nova-compute[75026]: No targets found.
Nov 10 19:46:52 user nova-compute[75026]: STATIC:
Nov 10 19:46:52 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4
Nov 10 19:46:52 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:46:52 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:46:52 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee
Nov 10 19:46:52 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:46:52 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:46:52 user nova-compute[75026]: FIRMWARE:
Nov 10 19:46:52 user nova-compute[75026]: No targets found.
Nov 10 19:46:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:46:52 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:46:52 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b34721b-c92e-4711-be90-c6ffab242d3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b33f06b-9136-4c08-9810-1dce3cad0454]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:46:52 user nova-compute[75026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:46:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 (non-flash)
Nov 10 19:46:52 user nova-compute[75026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:46:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed98211750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4'): ({'sde'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Removing single pathed devices sde {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0976fae-04e3-4f02-a77e-6ec288a1447e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5d2b63-d754-420e-ae5d-e2c5619fc973]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Flushing IO for device /dev/sde {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f3e3e3-9850-486b-b9ab-20bdd3a9e81b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47cafa-bb16-4c1d-9de5-5b7582660284]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] SCSI volumes sde have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0490a742-d92e-4f77-8262-5ec4f2c3e1c8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2134efa6-1531-44f5-9801-73d872921b1b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4, portal: 172.16.0.220,3260]
Nov 10 19:46:52 user nova-compute[75026]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4, portal: 172.16.0.220,3260] successful.
Nov 10 19:46:52 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36aa6f1b-2bbb-4a3a-9f20-7b36ede271e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ff381-c313-4764-8e24-db65fe8c3a7b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] <== disconnect_volume: return (322ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:46:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Deleting instance files /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804_del
Nov 10 19:46:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Deletion of /opt/stack/data/nova/instances/3b2146ef-84d2-4180-bea1-e0df77c56804_del complete
Nov 10 19:46:52 user nova-compute[75026]: INFO nova.compute.manager [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 10 19:46:52 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:46:52 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:46:53 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:46:53 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Took 0.42 seconds to deallocate network for instance.
Nov 10 19:46:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-18fcc089-10b3-4ddc-9e82-0ee5c02b186b req-2962ffad-6eff-46b3-a9b1-a1cd88183fe0 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-deleted-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:53 user nova-compute[75026]: INFO nova.compute.manager [req-18fcc089-10b3-4ddc-9e82-0ee5c02b186b req-2962ffad-6eff-46b3-a9b1-a1cd88183fe0 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Neutron deleted interface 927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e; detaching it from the instance and deleting it from the info cache
Nov 10 19:46:53 user nova-compute[75026]: DEBUG nova.network.neutron [req-18fcc089-10b3-4ddc-9e82-0ee5c02b186b req-2962ffad-6eff-46b3-a9b1-a1cd88183fe0 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:46:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-18fcc089-10b3-4ddc-9e82-0ee5c02b186b req-2962ffad-6eff-46b3-a9b1-a1cd88183fe0 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Detach interface failed, port_id=927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e, reason: Instance 3b2146ef-84d2-4180-bea1-e0df77c56804 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:46:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-339e479b-f4be-425b-856e-64f7fec8d77e req-5f5a64a7-cedd-4213-8fc2-fe200e168e16 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:46:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-339e479b-f4be-425b-856e-64f7fec8d77e req-5f5a64a7-cedd-4213-8fc2-fe200e168e16 service nova] Acquiring lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-339e479b-f4be-425b-856e-64f7fec8d77e req-5f5a64a7-cedd-4213-8fc2-fe200e168e16 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-339e479b-f4be-425b-856e-64f7fec8d77e req-5f5a64a7-cedd-4213-8fc2-fe200e168e16 service nova] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-339e479b-f4be-425b-856e-64f7fec8d77e req-5f5a64a7-cedd-4213-8fc2-fe200e168e16 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] No waiting events found dispatching network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:46:53 user nova-compute[75026]: WARNING nova.compute.manager [req-339e479b-f4be-425b-856e-64f7fec8d77e req-5f5a64a7-cedd-4213-8fc2-fe200e168e16 service nova] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Received unexpected event network-vif-plugged-927b3f92-a9c2-4505-b0a9-5c3b47bb4e3e for instance with vm_state active and task_state deleting.
Nov 10 19:46:54 user nova-compute[75026]: INFO nova.compute.manager [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: 3b2146ef-84d2-4180-bea1-e0df77c56804] Took 1.05 seconds to detach 1 volumes for instance.
Nov 10 19:46:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:46:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:46:54 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:46:54 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:46:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:54 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Deleted allocations for instance 3b2146ef-84d2-4180-bea1-e0df77c56804
Nov 10 19:46:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb3c825d-6fa9-4381-a346-5270d57e8a1f tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "3b2146ef-84d2-4180-bea1-e0df77c56804" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.087s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:46:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:47:06 user nova-compute[75026]: INFO nova.compute.claims [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Claim successful on node user
Nov 10 19:47:06 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:47:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.policy [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68746f97690e4928acbcade25680b895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1772dacf6532415e9fad0345cc6b6f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:47:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Creating image(s)
Nov 10 19:47:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "/opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "/opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "/opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "3dab6f263d96fda3e3988b32da16290d8b9ec067" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "3dab6f263d96fda3e3988b32da16290d8b9ec067" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.network.neutron [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Successfully created port: 4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067.part --force-share --output=json" returned: 0 in 0.238s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.virt.images [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] 12c435ae-4307-4c0f-8493-cfd0a1cf4afb was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:47:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067.part /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067.part /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067.converted" returned: 0 in 0.282s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067.converted --force-share --output=json" returned: 0 in 0.288s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "3dab6f263d96fda3e3988b32da16290d8b9ec067" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.277s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Successfully updated port: 4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-e72309e6-c68c-4643-ab7b-10b32ea85369 req-2a91562d-3b45-40fb-ad3e-b54b7ae3c311 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-e72309e6-c68c-4643-ab7b-10b32ea85369 req-2a91562d-3b45-40fb-ad3e-b54b7ae3c311 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing instance network info cache due to event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e72309e6-c68c-4643-ab7b-10b32ea85369 req-2a91562d-3b45-40fb-ad3e-b54b7ae3c311 service nova] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e72309e6-c68c-4643-ab7b-10b32ea85369 req-2a91562d-3b45-40fb-ad3e-b54b7ae3c311 service nova] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG nova.network.neutron [req-e72309e6-c68c-4643-ab7b-10b32ea85369 req-2a91562d-3b45-40fb-ad3e-b54b7ae3c311 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG nova.network.neutron [req-e72309e6-c68c-4643-ab7b-10b32ea85369 req-2a91562d-3b45-40fb-ad3e-b54b7ae3c311 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067 --force-share --output=json" returned: 0 in 0.209s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "3dab6f263d96fda3e3988b32da16290d8b9ec067" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "3dab6f263d96fda3e3988b32da16290d8b9ec067" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG nova.network.neutron [req-e72309e6-c68c-4643-ab7b-10b32ea85369 req-2a91562d-3b45-40fb-ad3e-b54b7ae3c311 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e72309e6-c68c-4643-ab7b-10b32ea85369 req-2a91562d-3b45-40fb-ad3e-b54b7ae3c311 service nova] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067 --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067,backing_fmt=raw /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG nova.network.neutron [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067,backing_fmt=raw /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk 1073741824" returned: 0 in 0.054s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "3dab6f263d96fda3e3988b32da16290d8b9ec067" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067 --force-share --output=json" returned: 0 in 0.195s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.network.neutron [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Cannot resize image /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Ensure instance console log exists: /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance network_info: |[{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Start _get_guest_xml network_info=[{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:47:03Z,direct_url=<?>,disk_format='qcow2',id=12c435ae-4307-4c0f-8493-cfd0a1cf4afb,min_disk=0,min_ram=0,name='tempest-scenario-img--934785467',owner='1772dacf6532415e9fad0345cc6b6f8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:47:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': '12c435ae-4307-4c0f-8493-cfd0a1cf4afb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:47:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:47:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:47:03Z,direct_url=<?>,disk_format='qcow2',id=12c435ae-4307-4c0f-8493-cfd0a1cf4afb,min_disk=0,min_ram=0,name='tempest-scenario-img--934785467',owner='1772dacf6532415e9fad0345cc6b6f8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:47:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-656161008',display_name='tempest-TestMinimumBasicScenario-server-656161008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-656161008',id=41,image_ref='12c435ae-4307-4c0f-8493-cfd0a1cf4afb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+3csZHnUhh75ldKllDaCNfIcRfbY/8tS/W+s6nwLTZV9cSeh7LnO9J3kkzMKOJ2mk798rAebKna3Hl1TzQbI/HbRN8MxbDtXJAYoJtcnrz4m2hbgndvBGrG4IFPjvblQ==',key_name='tempest-TestMinimumBasicScenario-237331585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-jr70i0gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='12c435ae-4307-4c0f-8493-cfd0a1cf4afb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:47:07Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=7991115d-773e-43a2-9a96-0738eea7c7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:9f:01,bridge_name='br-int',has_traffic_filtering=True,id=4e16e510-36df-416a-96ae-7e9227f9e146,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e16e510-36') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'pci_devices' on Instance uuid 7991115d-773e-43a2-9a96-0738eea7c7aa {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:47:09 user nova-compute[75026]:   <uuid>7991115d-773e-43a2-9a96-0738eea7c7aa</uuid>
Nov 10 19:47:09 user nova-compute[75026]:   <name>instance-00000029</name>
Nov 10 19:47:09 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:47:09 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:47:09 user nova-compute[75026]:   <metadata>
Nov 10 19:47:09 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:47:09 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:47:09 user nova-compute[75026]:       <nova:name>tempest-TestMinimumBasicScenario-server-656161008</nova:name>
Nov 10 19:47:09 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:47:09</nova:creationTime>
Nov 10 19:47:09 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:47:09 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:47:09 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:47:09 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:47:09 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:47:09 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:47:09 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:47:09 user nova-compute[75026]:       <nova:owner>
Nov 10 19:47:09 user nova-compute[75026]:         <nova:user uuid="68746f97690e4928acbcade25680b895">tempest-TestMinimumBasicScenario-966338622-project-member</nova:user>
Nov 10 19:47:09 user nova-compute[75026]:         <nova:project uuid="1772dacf6532415e9fad0345cc6b6f8f">tempest-TestMinimumBasicScenario-966338622</nova:project>
Nov 10 19:47:09 user nova-compute[75026]:       </nova:owner>
Nov 10 19:47:09 user nova-compute[75026]:       <nova:root type="image" uuid="12c435ae-4307-4c0f-8493-cfd0a1cf4afb"/>
Nov 10 19:47:09 user nova-compute[75026]:       <nova:ports>
Nov 10 19:47:09 user nova-compute[75026]:         <nova:port uuid="4e16e510-36df-416a-96ae-7e9227f9e146">
Nov 10 19:47:09 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 19:47:09 user nova-compute[75026]:         </nova:port>
Nov 10 19:47:09 user nova-compute[75026]:       </nova:ports>
Nov 10 19:47:09 user nova-compute[75026]:     </nova:instance>
Nov 10 19:47:09 user nova-compute[75026]:   </metadata>
Nov 10 19:47:09 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:47:09 user nova-compute[75026]:     <system>
Nov 10 19:47:09 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:47:09 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:47:09 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:47:09 user nova-compute[75026]:       <entry name="serial">7991115d-773e-43a2-9a96-0738eea7c7aa</entry>
Nov 10 19:47:09 user nova-compute[75026]:       <entry name="uuid">7991115d-773e-43a2-9a96-0738eea7c7aa</entry>
Nov 10 19:47:09 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:47:09 user nova-compute[75026]:     </system>
Nov 10 19:47:09 user nova-compute[75026]:   </sysinfo>
Nov 10 19:47:09 user nova-compute[75026]:   <os>
Nov 10 19:47:09 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:47:09 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:47:09 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:47:09 user nova-compute[75026]:   </os>
Nov 10 19:47:09 user nova-compute[75026]:   <features>
Nov 10 19:47:09 user nova-compute[75026]:     <acpi/>
Nov 10 19:47:09 user nova-compute[75026]:     <apic/>
Nov 10 19:47:09 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:47:09 user nova-compute[75026]:   </features>
Nov 10 19:47:09 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:47:09 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:47:09 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:47:09 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:47:09 user nova-compute[75026]:   </clock>
Nov 10 19:47:09 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:47:09 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:47:09 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:47:09 user nova-compute[75026]:   </cpu>
Nov 10 19:47:09 user nova-compute[75026]:   <devices>
Nov 10 19:47:09 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:47:09 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:47:09 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk"/>
Nov 10 19:47:09 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:47:09 user nova-compute[75026]:     </disk>
Nov 10 19:47:09 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:47:09 user nova-compute[75026]:       <mac address="fa:16:3e:22:9f:01"/>
Nov 10 19:47:09 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:47:09 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:47:09 user nova-compute[75026]:       <target dev="tap4e16e510-36"/>
Nov 10 19:47:09 user nova-compute[75026]:     </interface>
Nov 10 19:47:09 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:47:09 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/console.log" append="off"/>
Nov 10 19:47:09 user nova-compute[75026]:     </serial>
Nov 10 19:47:09 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:47:09 user nova-compute[75026]:     <video>
Nov 10 19:47:09 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:47:09 user nova-compute[75026]:     </video>
Nov 10 19:47:09 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:47:09 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:47:09 user nova-compute[75026]:     </rng>
Nov 10 19:47:09 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:47:09 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:47:09 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:47:09 user nova-compute[75026]:     </memballoon>
Nov 10 19:47:09 user nova-compute[75026]:   </devices>
Nov 10 19:47:09 user nova-compute[75026]: </domain>
Nov 10 19:47:09 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-656161008',display_name='tempest-TestMinimumBasicScenario-server-656161008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-656161008',id=41,image_ref='12c435ae-4307-4c0f-8493-cfd0a1cf4afb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+3csZHnUhh75ldKllDaCNfIcRfbY/8tS/W+s6nwLTZV9cSeh7LnO9J3kkzMKOJ2mk798rAebKna3Hl1TzQbI/HbRN8MxbDtXJAYoJtcnrz4m2hbgndvBGrG4IFPjvblQ==',key_name='tempest-TestMinimumBasicScenario-237331585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-jr70i0gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='12c435ae-4307-4c0f-8493-cfd0a1cf4afb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:47:07Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=7991115d-773e-43a2-9a96-0738eea7c7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:9f:01,bridge_name='br-int',has_traffic_filtering=True,id=4e16e510-36df-416a-96ae-7e9227f9e146,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e16e510-36') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG os_vif [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:9f:01,bridge_name='br-int',has_traffic_filtering=True,id=4e16e510-36df-416a-96ae-7e9227f9e146,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e16e510-36') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc4d66d9-0421-5a91-939b-d7a4190de3fb', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e16e510-36, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e16e510-36, col_values=(('qos', UUID('8aefc3c5-1d14-4c27-ae52-e34e62433e52')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e16e510-36, col_values=(('external_ids', {'iface-id': '4e16e510-36df-416a-96ae-7e9227f9e146', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:9f:01', 'vm-uuid': '7991115d-773e-43a2-9a96-0738eea7c7aa'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:09 user nova-compute[75026]: INFO os_vif [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:9f:01,bridge_name='br-int',has_traffic_filtering=True,id=4e16e510-36df-416a-96ae-7e9227f9e146,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e16e510-36')
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:47:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No VIF found with MAC fa:16:3e:22:9f:01, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:47:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-fb08d5d0-73f1-4c07-8484-09e24d08256a req-3ad9b47b-c47e-44b8-aada-503dbbe5eb79 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fb08d5d0-73f1-4c07-8484-09e24d08256a req-3ad9b47b-c47e-44b8-aada-503dbbe5eb79 service nova] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fb08d5d0-73f1-4c07-8484-09e24d08256a req-3ad9b47b-c47e-44b8-aada-503dbbe5eb79 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fb08d5d0-73f1-4c07-8484-09e24d08256a req-3ad9b47b-c47e-44b8-aada-503dbbe5eb79 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-fb08d5d0-73f1-4c07-8484-09e24d08256a req-3ad9b47b-c47e-44b8-aada-503dbbe5eb79 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] No waiting events found dispatching network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:47:10 user nova-compute[75026]: WARNING nova.compute.manager [req-fb08d5d0-73f1-4c07-8484-09e24d08256a req-3ad9b47b-c47e-44b8-aada-503dbbe5eb79 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received unexpected event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 for instance with vm_state building and task_state spawning.
Nov 10 19:47:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:47:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:47:12 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance spawned successfully.
Nov 10 19:47:12 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-8910903f-a1b0-4d20-bc83-501092a8b5a5 req-b1c44f73-c915-4610-9789-2ac09fa56e5a service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8910903f-a1b0-4d20-bc83-501092a8b5a5 req-b1c44f73-c915-4610-9789-2ac09fa56e5a service nova] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8910903f-a1b0-4d20-bc83-501092a8b5a5 req-b1c44f73-c915-4610-9789-2ac09fa56e5a service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8910903f-a1b0-4d20-bc83-501092a8b5a5 req-b1c44f73-c915-4610-9789-2ac09fa56e5a service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.compute.manager [req-8910903f-a1b0-4d20-bc83-501092a8b5a5 req-b1c44f73-c915-4610-9789-2ac09fa56e5a service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] No waiting events found dispatching network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:47:13 user nova-compute[75026]: WARNING nova.compute.manager [req-8910903f-a1b0-4d20-bc83-501092a8b5a5 req-b1c44f73-c915-4610-9789-2ac09fa56e5a service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received unexpected event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 for instance with vm_state building and task_state spawning.
Nov 10 19:47:13 user nova-compute[75026]: INFO nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 10 19:47:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:47:13 user nova-compute[75026]: INFO nova.compute.manager [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Took 6.76 seconds to build instance.
Nov 10 19:47:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-592645e3-8dcf-4996-bbec-345cb483bca5 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.869s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:47:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:47:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:47:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:47:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:47:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:27 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:47:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:28 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:29 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:47:29 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8319MB free_disk=25.19454574584961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b9e39b1a-3119-456e-b16d-192dbcd66ae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance b5d275d9-e5fe-425c-9dfb-270a989a6872 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5bf6de24-c6a5-4b68-ad60-7f582463016b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 7991115d-773e-43a2-9a96-0738eea7c7aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:47:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:47:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:47:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:47:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:47:32 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [{"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:47:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-9bcd68f9-db0e-4dd0-a831-c985e575ff9e" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:47:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:47:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:39 user nova-compute[75026]: INFO nova.compute.manager [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Terminating instance
Nov 10 19:47:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-2143e995-bb1c-432d-894f-2786cbecf87a req-ef1075aa-c15a-4ee4-82bb-0faf37833004 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-unplugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2143e995-bb1c-432d-894f-2786cbecf87a req-ef1075aa-c15a-4ee4-82bb-0faf37833004 service nova] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2143e995-bb1c-432d-894f-2786cbecf87a req-ef1075aa-c15a-4ee4-82bb-0faf37833004 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2143e995-bb1c-432d-894f-2786cbecf87a req-ef1075aa-c15a-4ee4-82bb-0faf37833004 service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-2143e995-bb1c-432d-894f-2786cbecf87a req-ef1075aa-c15a-4ee4-82bb-0faf37833004 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] No waiting events found dispatching network-vif-unplugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-2143e995-bb1c-432d-894f-2786cbecf87a req-ef1075aa-c15a-4ee4-82bb-0faf37833004 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-unplugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Instance destroyed successfully.
Nov 10 19:47:40 user nova-compute[75026]: DEBUG nova.objects.instance [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'resources' on Instance uuid 5bf6de24-c6a5-4b68-ad60-7f582463016b {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1250687212',display_name='tempest-ServerActionsTestOtherA-server-1250687212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1250687212',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:43:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-un001tri',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=5bf6de24-c6a5-4b68-ad60-7f582463016b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "address": "fa:16:3e:bc:60:f8", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc91a2c1-39", "ovs_interfaceid": "fc91a2c1-39c8-48ff-bb26-046aa507a18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_vif [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc91a2c1-39, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aeb7167-5dff-4070-a1a4-51cf0dd75d9d) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:40 user nova-compute[75026]: INFO os_vif [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:60:f8,bridge_name='br-int',has_traffic_filtering=True,id=fc91a2c1-39c8-48ff-bb26-046aa507a18e,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc91a2c1-39')
Nov 10 19:47:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWsJfgjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:47:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c1b03-6a34-4aea-88c3-e81dc80fb255]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:47:40 user nova-compute[75026]: No targets found.
Nov 10 19:47:40 user nova-compute[75026]: iSNS:
Nov 10 19:47:40 user nova-compute[75026]: No targets found.
Nov 10 19:47:40 user nova-compute[75026]: STATIC:
Nov 10 19:47:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee
Nov 10 19:47:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:47:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:47:40 user nova-compute[75026]: FIRMWARE:
Nov 10 19:47:40 user nova-compute[75026]: No targets found.
Nov 10 19:47:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:47:40 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:47:40 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b7395c-e77a-4092-af6f-3d860b0395f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f3542b-592b-4e38-b4a2-9058dfa19ab5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:47:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee (non-flash)
Nov 10 19:47:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0259630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee'): ({'sdd'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Removing single pathed devices sdd {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6812ee-9c9c-47d3-bc9c-d443ab1a6928]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6da958d-d126-4a70-80db-45e0f8270d5c]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Flushing IO for device /dev/sdd {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b8757f-243d-4a69-889a-00dea32aa584]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceba18df-887f-4ce7-b059-8397b3fa4298]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] SCSI volumes sdd have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_34f5597d', '/dev/disk/by-id/scsi-1SCST_BIO34f5597d-cb4e716f65002682', '/dev/disk/by-id/scsi-26362346537313666') {{(pid=86097) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cde386-fa0a-4dad-8a50-204faab58c2c]: (4, None) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[edac7a86-3139-4a1e-91d1-5f369006cfc1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c79a80d-0c2b-4f7c-b708-2f222fe2a5e3]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260]
Nov 10 19:47:40 user nova-compute[75026]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee, portal: 172.16.0.220,3260] successful.
Nov 10 19:47:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd193c6-af78-4e1e-a174-a556a57a0ff9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] <== disconnect_volume: return (346ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:47:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Deleting instance files /opt/stack/data/nova/instances/5bf6de24-c6a5-4b68-ad60-7f582463016b_del
Nov 10 19:47:40 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Deletion of /opt/stack/data/nova/instances/5bf6de24-c6a5-4b68-ad60-7f582463016b_del complete
Nov 10 19:47:40 user nova-compute[75026]: INFO nova.compute.manager [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 10 19:47:40 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:47:40 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:47:41 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:47:41 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Took 0.83 seconds to deallocate network for instance.
Nov 10 19:47:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-2f091aa8-6e14-4c72-a638-1c35a62e2cdf req-a107faeb-5bb9-4ef9-b288-cfbb39dcf2a5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-deleted-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:41 user nova-compute[75026]: INFO nova.compute.manager [req-2f091aa8-6e14-4c72-a638-1c35a62e2cdf req-a107faeb-5bb9-4ef9-b288-cfbb39dcf2a5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Neutron deleted interface fc91a2c1-39c8-48ff-bb26-046aa507a18e; detaching it from the instance and deleting it from the info cache
Nov 10 19:47:41 user nova-compute[75026]: DEBUG nova.network.neutron [req-2f091aa8-6e14-4c72-a638-1c35a62e2cdf req-a107faeb-5bb9-4ef9-b288-cfbb39dcf2a5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:47:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-2f091aa8-6e14-4c72-a638-1c35a62e2cdf req-a107faeb-5bb9-4ef9-b288-cfbb39dcf2a5 service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Detach interface failed, port_id=fc91a2c1-39c8-48ff-bb26-046aa507a18e, reason: Instance 5bf6de24-c6a5-4b68-ad60-7f582463016b could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 19:47:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-acb5ee43-928f-4e53-9c49-e2989ccb828d req-593c8adc-8bb0-4e2b-8500-f62c6e43741a service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-acb5ee43-928f-4e53-9c49-e2989ccb828d req-593c8adc-8bb0-4e2b-8500-f62c6e43741a service nova] Acquiring lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-acb5ee43-928f-4e53-9c49-e2989ccb828d req-593c8adc-8bb0-4e2b-8500-f62c6e43741a service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-acb5ee43-928f-4e53-9c49-e2989ccb828d req-593c8adc-8bb0-4e2b-8500-f62c6e43741a service nova] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:41 user nova-compute[75026]: DEBUG nova.compute.manager [req-acb5ee43-928f-4e53-9c49-e2989ccb828d req-593c8adc-8bb0-4e2b-8500-f62c6e43741a service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] No waiting events found dispatching network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:47:41 user nova-compute[75026]: WARNING nova.compute.manager [req-acb5ee43-928f-4e53-9c49-e2989ccb828d req-593c8adc-8bb0-4e2b-8500-f62c6e43741a service nova] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Received unexpected event network-vif-plugged-fc91a2c1-39c8-48ff-bb26-046aa507a18e for instance with vm_state active and task_state deleting.
Nov 10 19:47:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:42 user nova-compute[75026]: INFO nova.compute.manager [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Terminating instance
Nov 10 19:47:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:42 user nova-compute[75026]: INFO nova.compute.manager [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Took 1.12 seconds to detach 1 volumes for instance.
Nov 10 19:47:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 5bf6de24-c6a5-4b68-ad60-7f582463016b] Deleting volume: 4524fe5f-dcdc-4c1d-b900-7a94f3fe80ee {{(pid=75026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:47:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:42 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Deleted allocations for instance 5bf6de24-c6a5-4b68-ad60-7f582463016b
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-779150b9-1d0d-46fa-b24d-3ff973dbd9c8 tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "5bf6de24-c6a5-4b68-ad60-7f582463016b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.795s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Instance destroyed successfully.
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.objects.instance [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lazy-loading 'resources' on Instance uuid b9e39b1a-3119-456e-b16d-192dbcd66ae3 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1489498903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1489498903',id=19,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:25:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43e468483e8f4f70bd228ff8194d76b7',ramdisk_id='',reservation_id='r-aypge11s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:27:30Z,user_data=None,user_id='fcbd2be26ec84b5d9f6f6638963e870e',uuid=b9e39b1a-3119-456e-b16d-192dbcd66ae3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converting VIF {"id": "73693a79-982a-43ec-8930-07bc70a2033b", "address": "fa:16:3e:07:3f:9a", "network": {"id": "9aa07175-e243-438a-bb5b-d3b31279a8d3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1139177177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43e468483e8f4f70bd228ff8194d76b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73693a79-98", "ovs_interfaceid": "73693a79-982a-43ec-8930-07bc70a2033b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:3f:9a,bridge_name='br-int',has_traffic_filtering=True,id=73693a79-982a-43ec-8930-07bc70a2033b,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73693a79-98') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG os_vif [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:3f:9a,bridge_name='br-int',has_traffic_filtering=True,id=73693a79-982a-43ec-8930-07bc70a2033b,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73693a79-98') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73693a79-98, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e0fc991-70c9-4c87-90ba-65e04a9202c0) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:43 user nova-compute[75026]: INFO os_vif [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:3f:9a,bridge_name='br-int',has_traffic_filtering=True,id=73693a79-982a-43ec-8930-07bc70a2033b,network=Network(9aa07175-e243-438a-bb5b-d3b31279a8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73693a79-98')
Nov 10 19:47:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Deleting instance files /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3_del
Nov 10 19:47:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Deletion of /opt/stack/data/nova/instances/b9e39b1a-3119-456e-b16d-192dbcd66ae3_del complete
Nov 10 19:47:43 user nova-compute[75026]: INFO nova.compute.manager [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received event network-vif-unplugged-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] No waiting events found dispatching network-vif-unplugged-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received event network-vif-unplugged-73693a79-982a-43ec-8930-07bc70a2033b for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received event network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] Acquiring lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] No waiting events found dispatching network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:47:43 user nova-compute[75026]: WARNING nova.compute.manager [req-d7fd2c2e-eb34-445d-93e2-02d74a88b69c req-65dbe8f1-0a73-47dd-b896-3b4254187b74 service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received unexpected event network-vif-plugged-73693a79-982a-43ec-8930-07bc70a2033b for instance with vm_state active and task_state deleting.
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:47:43 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Took 0.53 seconds to deallocate network for instance.
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:47:43 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:47:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:44 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Deleted allocations for instance b9e39b1a-3119-456e-b16d-192dbcd66ae3
Nov 10 19:47:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-07594de4-f639-4ce0-a4e7-4075347206f3 tempest-ServerBootFromVolumeStableRescueTest-1118157225 tempest-ServerBootFromVolumeStableRescueTest-1118157225-project-member] Lock "b9e39b1a-3119-456e-b16d-192dbcd66ae3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.921s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:47:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-35b23b9a-722f-4391-8cda-36955c3a456e req-4887c740-0eec-4722-8ace-610222dd4a4e service nova] [instance: b9e39b1a-3119-456e-b16d-192dbcd66ae3] Received event network-vif-deleted-73693a79-982a-43ec-8930-07bc70a2033b {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:47:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:49 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:47:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:47:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:47:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:47:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:48:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:48:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:48:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:48:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:48:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:48:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:48:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:48:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:48:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:48:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:28 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:48:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:48:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.31548309326172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 7991115d-773e-43a2-9a96-0738eea7c7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:48:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:48:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 19:48:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:48:36 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:48:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:43 user nova-compute[75026]: INFO nova.compute.manager [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Terminating instance
Nov 10 19:48:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:44 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Instance destroyed successfully.
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lazy-loading 'resources' on Instance uuid 9bcd68f9-db0e-4dd0-a831-c985e575ff9e {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-330240232',display_name='tempest-ServerActionsTestOtherA-server-330240232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-330240232',id=21,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcJEQ/vQ74e6SphcGykpodCvAiO+KeOG5ge1UhzcKG/TvDCqFbXX22yAJFkGzmwfq+p5la318p+xoLjd8PiBzLypIGak0EBa0hnZnW/2xu+Ixqg8afPwySZnw421c1Wg==',key_name='tempest-keypair-1006091963',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:27:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdef98b8144148229b82888b888d88c5',ramdisk_id='',reservation_id='r-ixbl3asz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-664805234',owner_user_name='tempest-ServerActionsTestOtherA-664805234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4fcc097fff34ad2b2cc532d269e06bb',uuid=9bcd68f9-db0e-4dd0-a831-c985e575ff9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converting VIF {"id": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "address": "fa:16:3e:89:8c:86", "network": {"id": "ca0d9872-3cec-4be2-9725-c32d8c1fafed", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-236681753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdef98b8144148229b82888b888d88c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2b60a7f-66", "ovs_interfaceid": "b2b60a7f-6664-4ecd-8cf6-c4803546ee32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:8c:86,bridge_name='br-int',has_traffic_filtering=True,id=b2b60a7f-6664-4ecd-8cf6-c4803546ee32,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b60a7f-66') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG os_vif [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8c:86,bridge_name='br-int',has_traffic_filtering=True,id=b2b60a7f-6664-4ecd-8cf6-c4803546ee32,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b60a7f-66') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2b60a7f-66, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b47f8429-b8c3-44e0-b13f-02f5e1891cc8) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:48:44 user nova-compute[75026]: INFO os_vif [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8c:86,bridge_name='br-int',has_traffic_filtering=True,id=b2b60a7f-6664-4ecd-8cf6-c4803546ee32,network=Network(ca0d9872-3cec-4be2-9725-c32d8c1fafed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2b60a7f-66')
Nov 10 19:48:44 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Deleting instance files /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e_del
Nov 10 19:48:44 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Deletion of /opt/stack/data/nova/instances/9bcd68f9-db0e-4dd0-a831-c985e575ff9e_del complete
Nov 10 19:48:44 user nova-compute[75026]: INFO nova.compute.manager [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 10 19:48:44 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-eeb51aea-7ea8-4228-bf75-c0f4ae6568fe req-a018826f-d7c9-429f-8219-7f2918d01fd8 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-vif-unplugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-eeb51aea-7ea8-4228-bf75-c0f4ae6568fe req-a018826f-d7c9-429f-8219-7f2918d01fd8 service nova] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-eeb51aea-7ea8-4228-bf75-c0f4ae6568fe req-a018826f-d7c9-429f-8219-7f2918d01fd8 service nova] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-eeb51aea-7ea8-4228-bf75-c0f4ae6568fe req-a018826f-d7c9-429f-8219-7f2918d01fd8 service nova] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-eeb51aea-7ea8-4228-bf75-c0f4ae6568fe req-a018826f-d7c9-429f-8219-7f2918d01fd8 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] No waiting events found dispatching network-vif-unplugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:48:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-eeb51aea-7ea8-4228-bf75-c0f4ae6568fe req-a018826f-d7c9-429f-8219-7f2918d01fd8 service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-vif-unplugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:48:45 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:48:45 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Took 0.65 seconds to deallocate network for instance.
Nov 10 19:48:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:45 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:48:45 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:48:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:45 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Deleted allocations for instance 9bcd68f9-db0e-4dd0-a831-c985e575ff9e
Nov 10 19:48:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4af6733a-a8e4-4b6a-8231-9ddd50458b0f tempest-ServerActionsTestOtherA-664805234 tempest-ServerActionsTestOtherA-664805234-project-member] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.112s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-e9bec3c6-165f-4e1d-a8f5-a4117d5297e2 req-8daf188f-fbfc-48b2-b872-a36ccf8462ac service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:48:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e9bec3c6-165f-4e1d-a8f5-a4117d5297e2 req-8daf188f-fbfc-48b2-b872-a36ccf8462ac service nova] Acquiring lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e9bec3c6-165f-4e1d-a8f5-a4117d5297e2 req-8daf188f-fbfc-48b2-b872-a36ccf8462ac service nova] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e9bec3c6-165f-4e1d-a8f5-a4117d5297e2 req-8daf188f-fbfc-48b2-b872-a36ccf8462ac service nova] Lock "9bcd68f9-db0e-4dd0-a831-c985e575ff9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-e9bec3c6-165f-4e1d-a8f5-a4117d5297e2 req-8daf188f-fbfc-48b2-b872-a36ccf8462ac service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] No waiting events found dispatching network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:48:46 user nova-compute[75026]: WARNING nova.compute.manager [req-e9bec3c6-165f-4e1d-a8f5-a4117d5297e2 req-8daf188f-fbfc-48b2-b872-a36ccf8462ac service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received unexpected event network-vif-plugged-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 for instance with vm_state deleted and task_state None.
Nov 10 19:48:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-e9bec3c6-165f-4e1d-a8f5-a4117d5297e2 req-8daf188f-fbfc-48b2-b872-a36ccf8462ac service nova] [instance: 9bcd68f9-db0e-4dd0-a831-c985e575ff9e] Received event network-vif-deleted-b2b60a7f-6664-4ecd-8cf6-c4803546ee32 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:48:47 user nova-compute[75026]: INFO nova.compute.claims [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Claim successful on node user
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:48:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.policy [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0dd9bbcdce294a33b2692816caee276c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8508550b77e9441e939a122e28f723e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:48:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Creating image(s)
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.216s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk 1073741824" returned: 0 in 0.060s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Successfully created port: b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.202s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Cannot resize image /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Ensure instance console log exists: /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Successfully updated port: b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquired lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-7993d0b0-fc0f-4169-b957-f8717592644c req-e96c3c04-ab10-416b-8f9d-35d58fe26e43 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-changed-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-7993d0b0-fc0f-4169-b957-f8717592644c req-e96c3c04-ab10-416b-8f9d-35d58fe26e43 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Refreshing instance network info cache due to event network-changed-b9ef9cb5-fd20-4741-a044-e0c2728e29c3. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7993d0b0-fc0f-4169-b957-f8717592644c req-e96c3c04-ab10-416b-8f9d-35d58fe26e43 service nova] Acquiring lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Releasing lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance network_info: |[{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7993d0b0-fc0f-4169-b957-f8717592644c req-e96c3c04-ab10-416b-8f9d-35d58fe26e43 service nova] Acquired lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-7993d0b0-fc0f-4169-b957-f8717592644c req-e96c3c04-ab10-416b-8f9d-35d58fe26e43 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Refreshing network info cache for port b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Start _get_guest_xml network_info=[{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:48:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:48:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-908037026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-908037026',id=42,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIE1AtIt3kfTXM1U33jFPmfw8t4446A5GGx+ewqUknZgYlW/S9kG4yNVkxxN9+I6B0yYJVurvEn2AFRqt5Iqlwou9A9x/pA+qnM4fSat4ZcgHTQTxFELYbnUDGZ2W6rUA==',key_name='tempest-keypair-248868573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-fq6p8jz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:48:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=0f6ce7f9-77b9-4eaa-be26-d3a744b62998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.objects.instance [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:48:49 user nova-compute[75026]:   <uuid>0f6ce7f9-77b9-4eaa-be26-d3a744b62998</uuid>
Nov 10 19:48:49 user nova-compute[75026]:   <name>instance-0000002a</name>
Nov 10 19:48:49 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:48:49 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:48:49 user nova-compute[75026]:   <metadata>
Nov 10 19:48:49 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:48:49 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:48:49 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-908037026</nova:name>
Nov 10 19:48:49 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:48:49</nova:creationTime>
Nov 10 19:48:49 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:48:49 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:48:49 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:48:49 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:48:49 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:48:49 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:48:49 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:48:49 user nova-compute[75026]:       <nova:owner>
Nov 10 19:48:49 user nova-compute[75026]:         <nova:user uuid="0dd9bbcdce294a33b2692816caee276c">tempest-AttachVolumeShelveTestJSON-2009638513-project-member</nova:user>
Nov 10 19:48:49 user nova-compute[75026]:         <nova:project uuid="8508550b77e9441e939a122e28f723e5">tempest-AttachVolumeShelveTestJSON-2009638513</nova:project>
Nov 10 19:48:49 user nova-compute[75026]:       </nova:owner>
Nov 10 19:48:49 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:48:49 user nova-compute[75026]:       <nova:ports>
Nov 10 19:48:49 user nova-compute[75026]:         <nova:port uuid="b9ef9cb5-fd20-4741-a044-e0c2728e29c3">
Nov 10 19:48:49 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 19:48:49 user nova-compute[75026]:         </nova:port>
Nov 10 19:48:49 user nova-compute[75026]:       </nova:ports>
Nov 10 19:48:49 user nova-compute[75026]:     </nova:instance>
Nov 10 19:48:49 user nova-compute[75026]:   </metadata>
Nov 10 19:48:49 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:48:49 user nova-compute[75026]:     <system>
Nov 10 19:48:49 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:48:49 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:48:49 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:48:49 user nova-compute[75026]:       <entry name="serial">0f6ce7f9-77b9-4eaa-be26-d3a744b62998</entry>
Nov 10 19:48:49 user nova-compute[75026]:       <entry name="uuid">0f6ce7f9-77b9-4eaa-be26-d3a744b62998</entry>
Nov 10 19:48:49 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:48:49 user nova-compute[75026]:     </system>
Nov 10 19:48:49 user nova-compute[75026]:   </sysinfo>
Nov 10 19:48:49 user nova-compute[75026]:   <os>
Nov 10 19:48:49 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:48:49 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:48:49 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:48:49 user nova-compute[75026]:   </os>
Nov 10 19:48:49 user nova-compute[75026]:   <features>
Nov 10 19:48:49 user nova-compute[75026]:     <acpi/>
Nov 10 19:48:49 user nova-compute[75026]:     <apic/>
Nov 10 19:48:49 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:48:49 user nova-compute[75026]:   </features>
Nov 10 19:48:49 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:48:49 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:48:49 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:48:49 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:48:49 user nova-compute[75026]:   </clock>
Nov 10 19:48:49 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:48:49 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:48:49 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:48:49 user nova-compute[75026]:   </cpu>
Nov 10 19:48:49 user nova-compute[75026]:   <devices>
Nov 10 19:48:49 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:48:49 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:48:49 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk"/>
Nov 10 19:48:49 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:48:49 user nova-compute[75026]:     </disk>
Nov 10 19:48:49 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:48:49 user nova-compute[75026]:       <mac address="fa:16:3e:14:14:98"/>
Nov 10 19:48:49 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:48:49 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:48:49 user nova-compute[75026]:       <target dev="tapb9ef9cb5-fd"/>
Nov 10 19:48:49 user nova-compute[75026]:     </interface>
Nov 10 19:48:49 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:48:49 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/console.log" append="off"/>
Nov 10 19:48:49 user nova-compute[75026]:     </serial>
Nov 10 19:48:49 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:48:49 user nova-compute[75026]:     <video>
Nov 10 19:48:49 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:48:49 user nova-compute[75026]:     </video>
Nov 10 19:48:49 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:48:49 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:48:49 user nova-compute[75026]:     </rng>
Nov 10 19:48:49 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:48:49 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:48:49 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:48:49 user nova-compute[75026]:     </memballoon>
Nov 10 19:48:49 user nova-compute[75026]:   </devices>
Nov 10 19:48:49 user nova-compute[75026]: </domain>
Nov 10 19:48:49 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-908037026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-908037026',id=42,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIE1AtIt3kfTXM1U33jFPmfw8t4446A5GGx+ewqUknZgYlW/S9kG4yNVkxxN9+I6B0yYJVurvEn2AFRqt5Iqlwou9A9x/pA+qnM4fSat4ZcgHTQTxFELYbnUDGZ2W6rUA==',key_name='tempest-keypair-248868573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-fq6p8jz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:48:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=0f6ce7f9-77b9-4eaa-be26-d3a744b62998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG os_vif [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdb34f7e-b465-5d61-919f-d8a4abcea30d', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9ef9cb5-fd, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9ef9cb5-fd, col_values=(('qos', UUID('c8e0b58d-75d2-410f-a500-0f31154fe202')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9ef9cb5-fd, col_values=(('external_ids', {'iface-id': 'b9ef9cb5-fd20-4741-a044-e0c2728e29c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:14:98', 'vm-uuid': '0f6ce7f9-77b9-4eaa-be26-d3a744b62998'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:49 user nova-compute[75026]: INFO os_vif [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd')
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No VIF found with MAC fa:16:3e:14:14:98, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-7993d0b0-fc0f-4169-b957-f8717592644c req-e96c3c04-ab10-416b-8f9d-35d58fe26e43 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updated VIF entry in instance network info cache for port b9ef9cb5-fd20-4741-a044-e0c2728e29c3. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-7993d0b0-fc0f-4169-b957-f8717592644c req-e96c3c04-ab10-416b-8f9d-35d58fe26e43 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:48:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7993d0b0-fc0f-4169-b957-f8717592644c req-e96c3c04-ab10-416b-8f9d-35d58fe26e43 service nova] Releasing lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-4e93db20-0890-4fb0-852c-bb88facb9aaa req-7ed02e4b-52ef-4326-b840-03e3d03e51c1 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4e93db20-0890-4fb0-852c-bb88facb9aaa req-7ed02e4b-52ef-4326-b840-03e3d03e51c1 service nova] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4e93db20-0890-4fb0-852c-bb88facb9aaa req-7ed02e4b-52ef-4326-b840-03e3d03e51c1 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4e93db20-0890-4fb0-852c-bb88facb9aaa req-7ed02e4b-52ef-4326-b840-03e3d03e51c1 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-4e93db20-0890-4fb0-852c-bb88facb9aaa req-7ed02e4b-52ef-4326-b840-03e3d03e51c1 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] No waiting events found dispatching network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:48:51 user nova-compute[75026]: WARNING nova.compute.manager [req-4e93db20-0890-4fb0-852c-bb88facb9aaa req-7ed02e4b-52ef-4326-b840-03e3d03e51c1 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received unexpected event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 for instance with vm_state building and task_state spawning.
Nov 10 19:48:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:48:53 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance spawned successfully.
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:48:53 user nova-compute[75026]: INFO nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-29aaddf0-07da-4416-9106-139f82752c7f req-79773316-f481-4a34-b483-edd972947bd9 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-29aaddf0-07da-4416-9106-139f82752c7f req-79773316-f481-4a34-b483-edd972947bd9 service nova] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-29aaddf0-07da-4416-9106-139f82752c7f req-79773316-f481-4a34-b483-edd972947bd9 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-29aaddf0-07da-4416-9106-139f82752c7f req-79773316-f481-4a34-b483-edd972947bd9 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-29aaddf0-07da-4416-9106-139f82752c7f req-79773316-f481-4a34-b483-edd972947bd9 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] No waiting events found dispatching network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:48:53 user nova-compute[75026]: WARNING nova.compute.manager [req-29aaddf0-07da-4416-9106-139f82752c7f req-79773316-f481-4a34-b483-edd972947bd9 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received unexpected event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 for instance with vm_state building and task_state spawning.
Nov 10 19:48:53 user nova-compute[75026]: INFO nova.compute.manager [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Took 6.28 seconds to build instance.
Nov 10 19:48:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e7ef5ce5-00cc-4594-9229-a81cb602ac4b tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.383s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:48:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:48:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'flavor' on Instance uuid 7991115d-773e-43a2-9a96-0738eea7c7aa {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:02 user nova-compute[75026]: INFO nova.compute.manager [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Attaching volume dbba4835-ee64-4c61-aa65-c8b6703c3630 to /dev/vdb
Nov 10 19:49:02 user nova-compute[75026]: DEBUG os_brick.utils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec6d9f-2d5c-4d85-ac79-a6dc4f3735ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac23b139-abf4-47dd-8946-8134f2fe5ac1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b536177-d8ea-4c2b-8b3d-0e416369a022]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[824d7196-ef57-4257-8a4c-a4a01f8a31bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:49:03 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:49:03 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c97f6b-d235-426e-bf22-c9b97949ed55]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG os_brick.utils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:49:03 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating existing volume attachment record: 8fc76704-a3d4-4d36-8dc2-5d294dd44cd5 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:49:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:49:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBZOTWUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:49:27 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:49:27 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:49:27 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[835da025-f198-4636-9fe4-90b084b159a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:49:27 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d756ef3a-96cb-4e35-b6c7-3c7920b36898]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630] added
Nov 10 19:49:27 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4048bcc3-96c4-4514-9757-eea69394708d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18737ad4-2e21-4002-9225-3da621aafae6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBZOTWUG {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBZOTWUG" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c006e07b-0d0b-488e-9358-603deec9196f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBZOTWUG'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9412e1-b9da-4e22-a352-1d53448a9973]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823e8a1-2d8e-4c42-a2f9-368b86c59809]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:49:27 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:49:27 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:49:27 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:49:27 user nova-compute[75026]: 
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c6a36a-178f-4c3b-8036-53abfb0ead13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630, portal: 172.16.0.220,3260]
Nov 10 19:49:27 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630, portal: 172.16.0.220,3260] successful.
Nov 10 19:49:27 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[048aff4a-c5ab-4bbf-9231-14063cd71c0b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31f938a-4622-4fd5-b8ce-af655d9411ab]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 (non-flash)
Nov 10 19:49:27 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 (non-flash)
Nov 10 19:49:27 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee3a708-ae34-4abe-a084-4267832b3cff]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:49:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBZOTWUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:49:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:49:28 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23063303739333636', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:49:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063303739333636', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:49:28 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'flavor' on Instance uuid 7991115d-773e-43a2-9a96-0738eea7c7aa {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:49:29 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:49:29 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:49:29 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:49:29 user nova-compute[75026]:   <serial>dbba4835-ee64-4c61-aa65-c8b6703c3630</serial>
Nov 10 19:49:29 user nova-compute[75026]: </disk>
Nov 10 19:49:29 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] No VIF found with MAC fa:16:3e:22:9f:01, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cbc4d21c-5421-4de6-a660-b8c44aac6ec4 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.748s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:49:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:49:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:49:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8619MB free_disk=25.302955627441406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 7991115d-773e-43a2-9a96-0738eea7c7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:49:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-e4abe7ed-b556-442a-85c2-5c2b08633212 req-ce007bf7-9d52-48f3-9a00-73c7603c2c7a service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-e4abe7ed-b556-442a-85c2-5c2b08633212 req-ce007bf7-9d52-48f3-9a00-73c7603c2c7a service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing instance network info cache due to event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e4abe7ed-b556-442a-85c2-5c2b08633212 req-ce007bf7-9d52-48f3-9a00-73c7603c2c7a service nova] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e4abe7ed-b556-442a-85c2-5c2b08633212 req-ce007bf7-9d52-48f3-9a00-73c7603c2c7a service nova] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG nova.network.neutron [req-e4abe7ed-b556-442a-85c2-5c2b08633212 req-ce007bf7-9d52-48f3-9a00-73c7603c2c7a service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG nova.network.neutron [req-e4abe7ed-b556-442a-85c2-5c2b08633212 req-ce007bf7-9d52-48f3-9a00-73c7603c2c7a service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updated VIF entry in instance network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG nova.network.neutron [req-e4abe7ed-b556-442a-85c2-5c2b08633212 req-ce007bf7-9d52-48f3-9a00-73c7603c2c7a service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e4abe7ed-b556-442a-85c2-5c2b08633212 req-ce007bf7-9d52-48f3-9a00-73c7603c2c7a service nova] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:49:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:33 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:49:33 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:49:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:49:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:49:33 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:49:33 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 7991115d-773e-43a2-9a96-0738eea7c7aa {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-a99830d3-bdf8-45b5-983a-01bb177f1dbf req-45948bdb-78ec-49aa-a68c-9101e74b10b0 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-a99830d3-bdf8-45b5-983a-01bb177f1dbf req-45948bdb-78ec-49aa-a68c-9101e74b10b0 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing instance network info cache due to event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a99830d3-bdf8-45b5-983a-01bb177f1dbf req-45948bdb-78ec-49aa-a68c-9101e74b10b0 service nova] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a99830d3-bdf8-45b5-983a-01bb177f1dbf req-45948bdb-78ec-49aa-a68c-9101e74b10b0 service nova] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:49:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-a99830d3-bdf8-45b5-983a-01bb177f1dbf req-45948bdb-78ec-49aa-a68c-9101e74b10b0 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:35 user nova-compute[75026]: INFO nova.compute.manager [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Rebooting instance
Nov 10 19:49:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG nova.network.neutron [req-a99830d3-bdf8-45b5-983a-01bb177f1dbf req-45948bdb-78ec-49aa-a68c-9101e74b10b0 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updated VIF entry in instance network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG nova.network.neutron [req-a99830d3-bdf8-45b5-983a-01bb177f1dbf req-45948bdb-78ec-49aa-a68c-9101e74b10b0 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a99830d3-bdf8-45b5-983a-01bb177f1dbf req-45948bdb-78ec-49aa-a68c-9101e74b10b0 service nova] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:49:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-85eee59d-60e9-425f-869b-e03d4109d855 req-18214982-de65-4d79-8c0d-b33b6c5539a9 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-unplugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-85eee59d-60e9-425f-869b-e03d4109d855 req-18214982-de65-4d79-8c0d-b33b6c5539a9 service nova] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-85eee59d-60e9-425f-869b-e03d4109d855 req-18214982-de65-4d79-8c0d-b33b6c5539a9 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-85eee59d-60e9-425f-869b-e03d4109d855 req-18214982-de65-4d79-8c0d-b33b6c5539a9 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-85eee59d-60e9-425f-869b-e03d4109d855 req-18214982-de65-4d79-8c0d-b33b6c5539a9 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] No waiting events found dispatching network-vif-unplugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:49:38 user nova-compute[75026]: WARNING nova.compute.manager [req-85eee59d-60e9-425f-869b-e03d4109d855 req-18214982-de65-4d79-8c0d-b33b6c5539a9 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received unexpected event network-vif-unplugged-4e16e510-36df-416a-96ae-7e9227f9e146 for instance with vm_state active and task_state reboot_started.
Nov 10 19:49:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:49:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:49:38 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance shutdown successfully.
Nov 10 19:49:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-8c6e4da4-3cad-4c4f-9bb8-c1315b560c3b req-cb14c049-b425-4cd0-9014-ae56e76d40cd service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c6e4da4-3cad-4c4f-9bb8-c1315b560c3b req-cb14c049-b425-4cd0-9014-ae56e76d40cd service nova] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c6e4da4-3cad-4c4f-9bb8-c1315b560c3b req-cb14c049-b425-4cd0-9014-ae56e76d40cd service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8c6e4da4-3cad-4c4f-9bb8-c1315b560c3b req-cb14c049-b425-4cd0-9014-ae56e76d40cd service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-8c6e4da4-3cad-4c4f-9bb8-c1315b560c3b req-cb14c049-b425-4cd0-9014-ae56e76d40cd service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] No waiting events found dispatching network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:49:40 user nova-compute[75026]: WARNING nova.compute.manager [req-8c6e4da4-3cad-4c4f-9bb8-c1315b560c3b req-cb14c049-b425-4cd0-9014-ae56e76d40cd service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received unexpected event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 for instance with vm_state active and task_state reboot_started.
Nov 10 19:49:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] No waiting events found dispatching network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:49:42 user nova-compute[75026]: WARNING nova.compute.manager [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received unexpected event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 for instance with vm_state active and task_state reboot_started.
Nov 10 19:49:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] No waiting events found dispatching network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:49:42 user nova-compute[75026]: WARNING nova.compute.manager [req-be08db79-1e2d-4f71-ad72-ec0b8fb547fe req-bf35e64f-6aa1-4164-a23d-fa0cc4da5be6 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received unexpected event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 for instance with vm_state active and task_state reboot_started.
Nov 10 19:49:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance running successfully.
Nov 10 19:49:42 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance soft rebooted successfully.
Nov 10 19:49:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:49:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cb532df5-bf2e-4b17-9726-652d29e0d52b tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.357s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:49:47 user nova-compute[75026]: INFO nova.compute.claims [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Claim successful on node user
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:49:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.policy [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7ef73abaece4f08b00d81d403a8a66a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d8f446a3094348839f9216faff0485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:49:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Creating image(s)
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:49:47 user nova-compute[75026]: INFO nova.compute.claims [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Claim successful on node user
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk 1073741824" returned: 0 in 0.074s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Successfully created port: 21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Cannot resize image /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Ensure instance console log exists: /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:49:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.policy [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7ef73abaece4f08b00d81d403a8a66a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d8f446a3094348839f9216faff0485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:49:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Creating image(s)
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Successfully updated port: 21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-a494d895-a820-4319-8e49-f3ca5e6d9f1a req-596b79af-ba86-4c86-b513-c404917f04cc service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-changed-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-a494d895-a820-4319-8e49-f3ca5e6d9f1a req-596b79af-ba86-4c86-b513-c404917f04cc service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Refreshing instance network info cache due to event network-changed-21c048fe-3b5b-4287-bf6e-f5df5a6812fa. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a494d895-a820-4319-8e49-f3ca5e6d9f1a req-596b79af-ba86-4c86-b513-c404917f04cc service nova] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk 1073741824" returned: 0 in 0.057s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Cannot resize image /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Ensure instance console log exists: /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Successfully created port: b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance network_info: |[{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a494d895-a820-4319-8e49-f3ca5e6d9f1a req-596b79af-ba86-4c86-b513-c404917f04cc service nova] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.network.neutron [req-a494d895-a820-4319-8e49-f3ca5e6d9f1a req-596b79af-ba86-4c86-b513-c404917f04cc service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Refreshing network info cache for port 21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Start _get_guest_xml network_info=[{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:49:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:49:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:49:49 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-864115750',display_name='tempest-ServerRescueNegativeTestJSON-server-864115750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-864115750',id=43,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-9ybrbs1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:49:48Z,user_data=None,user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=39176d38-43bf-49b4-8f64-cd16b5ada8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ae:d8,bridge_name='br-int',has_traffic_filtering=True,id=21c048fe-3b5b-4287-bf6e-f5df5a6812fa,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c048fe-3b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.objects.instance [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'pci_devices' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:49:50 user nova-compute[75026]:   <uuid>39176d38-43bf-49b4-8f64-cd16b5ada8a7</uuid>
Nov 10 19:49:50 user nova-compute[75026]:   <name>instance-0000002b</name>
Nov 10 19:49:50 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:49:50 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:49:50 user nova-compute[75026]:   <metadata>
Nov 10 19:49:50 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:49:50 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:49:50 user nova-compute[75026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-864115750</nova:name>
Nov 10 19:49:50 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:49:49</nova:creationTime>
Nov 10 19:49:50 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:49:50 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:49:50 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:49:50 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:49:50 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:49:50 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:49:50 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:49:50 user nova-compute[75026]:       <nova:owner>
Nov 10 19:49:50 user nova-compute[75026]:         <nova:user uuid="b7ef73abaece4f08b00d81d403a8a66a">tempest-ServerRescueNegativeTestJSON-1130240525-project-member</nova:user>
Nov 10 19:49:50 user nova-compute[75026]:         <nova:project uuid="64d8f446a3094348839f9216faff0485">tempest-ServerRescueNegativeTestJSON-1130240525</nova:project>
Nov 10 19:49:50 user nova-compute[75026]:       </nova:owner>
Nov 10 19:49:50 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:49:50 user nova-compute[75026]:       <nova:ports>
Nov 10 19:49:50 user nova-compute[75026]:         <nova:port uuid="21c048fe-3b5b-4287-bf6e-f5df5a6812fa">
Nov 10 19:49:50 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 19:49:50 user nova-compute[75026]:         </nova:port>
Nov 10 19:49:50 user nova-compute[75026]:       </nova:ports>
Nov 10 19:49:50 user nova-compute[75026]:     </nova:instance>
Nov 10 19:49:50 user nova-compute[75026]:   </metadata>
Nov 10 19:49:50 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:49:50 user nova-compute[75026]:     <system>
Nov 10 19:49:50 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:49:50 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:49:50 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:49:50 user nova-compute[75026]:       <entry name="serial">39176d38-43bf-49b4-8f64-cd16b5ada8a7</entry>
Nov 10 19:49:50 user nova-compute[75026]:       <entry name="uuid">39176d38-43bf-49b4-8f64-cd16b5ada8a7</entry>
Nov 10 19:49:50 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:49:50 user nova-compute[75026]:     </system>
Nov 10 19:49:50 user nova-compute[75026]:   </sysinfo>
Nov 10 19:49:50 user nova-compute[75026]:   <os>
Nov 10 19:49:50 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:49:50 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:49:50 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:49:50 user nova-compute[75026]:   </os>
Nov 10 19:49:50 user nova-compute[75026]:   <features>
Nov 10 19:49:50 user nova-compute[75026]:     <acpi/>
Nov 10 19:49:50 user nova-compute[75026]:     <apic/>
Nov 10 19:49:50 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:49:50 user nova-compute[75026]:   </features>
Nov 10 19:49:50 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:49:50 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:49:50 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:49:50 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:49:50 user nova-compute[75026]:   </clock>
Nov 10 19:49:50 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:49:50 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:49:50 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:49:50 user nova-compute[75026]:   </cpu>
Nov 10 19:49:50 user nova-compute[75026]:   <devices>
Nov 10 19:49:50 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:49:50 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:49:50 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk"/>
Nov 10 19:49:50 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:49:50 user nova-compute[75026]:     </disk>
Nov 10 19:49:50 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:49:50 user nova-compute[75026]:       <mac address="fa:16:3e:2e:ae:d8"/>
Nov 10 19:49:50 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:49:50 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:49:50 user nova-compute[75026]:       <target dev="tap21c048fe-3b"/>
Nov 10 19:49:50 user nova-compute[75026]:     </interface>
Nov 10 19:49:50 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:49:50 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/console.log" append="off"/>
Nov 10 19:49:50 user nova-compute[75026]:     </serial>
Nov 10 19:49:50 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:49:50 user nova-compute[75026]:     <video>
Nov 10 19:49:50 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:49:50 user nova-compute[75026]:     </video>
Nov 10 19:49:50 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:49:50 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:49:50 user nova-compute[75026]:     </rng>
Nov 10 19:49:50 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:49:50 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:49:50 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:49:50 user nova-compute[75026]:     </memballoon>
Nov 10 19:49:50 user nova-compute[75026]:   </devices>
Nov 10 19:49:50 user nova-compute[75026]: </domain>
Nov 10 19:49:50 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-864115750',display_name='tempest-ServerRescueNegativeTestJSON-server-864115750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-864115750',id=43,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-9ybrbs1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:49:48Z,user_data=None,user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=39176d38-43bf-49b4-8f64-cd16b5ada8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ae:d8,bridge_name='br-int',has_traffic_filtering=True,id=21c048fe-3b5b-4287-bf6e-f5df5a6812fa,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c048fe-3b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG os_vif [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ae:d8,bridge_name='br-int',has_traffic_filtering=True,id=21c048fe-3b5b-4287-bf6e-f5df5a6812fa,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c048fe-3b') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fb541e5-473c-5202-8d89-f9a1dc765789', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21c048fe-3b, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21c048fe-3b, col_values=(('qos', UUID('2c7e1dea-aef1-4128-bf20-9d77ed13803e')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21c048fe-3b, col_values=(('external_ids', {'iface-id': '21c048fe-3b5b-4287-bf6e-f5df5a6812fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ae:d8', 'vm-uuid': '39176d38-43bf-49b4-8f64-cd16b5ada8a7'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:50 user nova-compute[75026]: INFO os_vif [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ae:d8,bridge_name='br-int',has_traffic_filtering=True,id=21c048fe-3b5b-4287-bf6e-f5df5a6812fa,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c048fe-3b')
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No VIF found with MAC fa:16:3e:2e:ae:d8, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.neutron [req-a494d895-a820-4319-8e49-f3ca5e6d9f1a req-596b79af-ba86-4c86-b513-c404917f04cc service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updated VIF entry in instance network info cache for port 21c048fe-3b5b-4287-bf6e-f5df5a6812fa. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.neutron [req-a494d895-a820-4319-8e49-f3ca5e6d9f1a req-596b79af-ba86-4c86-b513-c404917f04cc service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a494d895-a820-4319-8e49-f3ca5e6d9f1a req-596b79af-ba86-4c86-b513-c404917f04cc service nova] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.neutron [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Successfully updated port: b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquired lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.neutron [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:49:50 user nova-compute[75026]: DEBUG nova.network.neutron [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.network.neutron [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updating instance_info_cache with network_info: [{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Releasing lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Instance network_info: |[{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Start _get_guest_xml network_info=[{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:49:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:49:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1152529874',display_name='tempest-ServerRescueNegativeTestJSON-server-1152529874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1152529874',id=44,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-omi3z18y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:49:49Z,user_data=None,user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=1d69dbab-693c-462e-b8e9-d53a4e311e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=b4dac984-0d9c-4ce9-9024-7ce2f87e4048,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dac984-0d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.objects.instance [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-ecf5a996-e077-4540-be9b-4c1e6cf5caa5 req-c774769b-2ec7-4d9c-9c6b-dc4d7f22bd2f service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-changed-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-ecf5a996-e077-4540-be9b-4c1e6cf5caa5 req-c774769b-2ec7-4d9c-9c6b-dc4d7f22bd2f service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Refreshing instance network info cache due to event network-changed-b4dac984-0d9c-4ce9-9024-7ce2f87e4048. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ecf5a996-e077-4540-be9b-4c1e6cf5caa5 req-c774769b-2ec7-4d9c-9c6b-dc4d7f22bd2f service nova] Acquiring lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ecf5a996-e077-4540-be9b-4c1e6cf5caa5 req-c774769b-2ec7-4d9c-9c6b-dc4d7f22bd2f service nova] Acquired lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.network.neutron [req-ecf5a996-e077-4540-be9b-4c1e6cf5caa5 req-c774769b-2ec7-4d9c-9c6b-dc4d7f22bd2f service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Refreshing network info cache for port b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:49:51 user nova-compute[75026]:   <uuid>1d69dbab-693c-462e-b8e9-d53a4e311e30</uuid>
Nov 10 19:49:51 user nova-compute[75026]:   <name>instance-0000002c</name>
Nov 10 19:49:51 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:49:51 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:49:51 user nova-compute[75026]:   <metadata>
Nov 10 19:49:51 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:49:51 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:49:51 user nova-compute[75026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1152529874</nova:name>
Nov 10 19:49:51 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:49:51</nova:creationTime>
Nov 10 19:49:51 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:49:51 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:49:51 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:49:51 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:49:51 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:49:51 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:49:51 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:49:51 user nova-compute[75026]:       <nova:owner>
Nov 10 19:49:51 user nova-compute[75026]:         <nova:user uuid="b7ef73abaece4f08b00d81d403a8a66a">tempest-ServerRescueNegativeTestJSON-1130240525-project-member</nova:user>
Nov 10 19:49:51 user nova-compute[75026]:         <nova:project uuid="64d8f446a3094348839f9216faff0485">tempest-ServerRescueNegativeTestJSON-1130240525</nova:project>
Nov 10 19:49:51 user nova-compute[75026]:       </nova:owner>
Nov 10 19:49:51 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:49:51 user nova-compute[75026]:       <nova:ports>
Nov 10 19:49:51 user nova-compute[75026]:         <nova:port uuid="b4dac984-0d9c-4ce9-9024-7ce2f87e4048">
Nov 10 19:49:51 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 19:49:51 user nova-compute[75026]:         </nova:port>
Nov 10 19:49:51 user nova-compute[75026]:       </nova:ports>
Nov 10 19:49:51 user nova-compute[75026]:     </nova:instance>
Nov 10 19:49:51 user nova-compute[75026]:   </metadata>
Nov 10 19:49:51 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:49:51 user nova-compute[75026]:     <system>
Nov 10 19:49:51 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:49:51 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:49:51 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:49:51 user nova-compute[75026]:       <entry name="serial">1d69dbab-693c-462e-b8e9-d53a4e311e30</entry>
Nov 10 19:49:51 user nova-compute[75026]:       <entry name="uuid">1d69dbab-693c-462e-b8e9-d53a4e311e30</entry>
Nov 10 19:49:51 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:49:51 user nova-compute[75026]:     </system>
Nov 10 19:49:51 user nova-compute[75026]:   </sysinfo>
Nov 10 19:49:51 user nova-compute[75026]:   <os>
Nov 10 19:49:51 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:49:51 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:49:51 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:49:51 user nova-compute[75026]:   </os>
Nov 10 19:49:51 user nova-compute[75026]:   <features>
Nov 10 19:49:51 user nova-compute[75026]:     <acpi/>
Nov 10 19:49:51 user nova-compute[75026]:     <apic/>
Nov 10 19:49:51 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:49:51 user nova-compute[75026]:   </features>
Nov 10 19:49:51 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:49:51 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:49:51 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:49:51 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:49:51 user nova-compute[75026]:   </clock>
Nov 10 19:49:51 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:49:51 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:49:51 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:49:51 user nova-compute[75026]:   </cpu>
Nov 10 19:49:51 user nova-compute[75026]:   <devices>
Nov 10 19:49:51 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:49:51 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:49:51 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk"/>
Nov 10 19:49:51 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:49:51 user nova-compute[75026]:     </disk>
Nov 10 19:49:51 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:49:51 user nova-compute[75026]:       <mac address="fa:16:3e:da:5a:01"/>
Nov 10 19:49:51 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:49:51 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:49:51 user nova-compute[75026]:       <target dev="tapb4dac984-0d"/>
Nov 10 19:49:51 user nova-compute[75026]:     </interface>
Nov 10 19:49:51 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:49:51 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/console.log" append="off"/>
Nov 10 19:49:51 user nova-compute[75026]:     </serial>
Nov 10 19:49:51 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:49:51 user nova-compute[75026]:     <video>
Nov 10 19:49:51 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:49:51 user nova-compute[75026]:     </video>
Nov 10 19:49:51 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:49:51 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:49:51 user nova-compute[75026]:     </rng>
Nov 10 19:49:51 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:49:51 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:49:51 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:49:51 user nova-compute[75026]:     </memballoon>
Nov 10 19:49:51 user nova-compute[75026]:   </devices>
Nov 10 19:49:51 user nova-compute[75026]: </domain>
Nov 10 19:49:51 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1152529874',display_name='tempest-ServerRescueNegativeTestJSON-server-1152529874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1152529874',id=44,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-omi3z18y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:49:49Z,user_data=None,user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=1d69dbab-693c-462e-b8e9-d53a4e311e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=b4dac984-0d9c-4ce9-9024-7ce2f87e4048,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dac984-0d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG os_vif [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=b4dac984-0d9c-4ce9-9024-7ce2f87e4048,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dac984-0d') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5fd3f66-f32e-5754-8b5c-17bb01eb571c', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4dac984-0d, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4dac984-0d, col_values=(('qos', UUID('b57989c9-9ba6-4724-9857-b155c0a4dbd0')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4dac984-0d, col_values=(('external_ids', {'iface-id': 'b4dac984-0d9c-4ce9-9024-7ce2f87e4048', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:5a:01', 'vm-uuid': '1d69dbab-693c-462e-b8e9-d53a4e311e30'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: INFO os_vif [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=b4dac984-0d9c-4ce9-9024-7ce2f87e4048,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dac984-0d')
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No VIF found with MAC fa:16:3e:da:5a:01, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.network.neutron [req-ecf5a996-e077-4540-be9b-4c1e6cf5caa5 req-c774769b-2ec7-4d9c-9c6b-dc4d7f22bd2f service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updated VIF entry in instance network info cache for port b4dac984-0d9c-4ce9-9024-7ce2f87e4048. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.network.neutron [req-ecf5a996-e077-4540-be9b-4c1e6cf5caa5 req-c774769b-2ec7-4d9c-9c6b-dc4d7f22bd2f service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updating instance_info_cache with network_info: [{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ecf5a996-e077-4540-be9b-4c1e6cf5caa5 req-c774769b-2ec7-4d9c-9c6b-dc4d7f22bd2f service nova] Releasing lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-5077bfa8-5a67-4be0-b517-a8d712f06d0d req-0066b4b5-16d6-4fdc-b8a9-c87038bd5197 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5077bfa8-5a67-4be0-b517-a8d712f06d0d req-0066b4b5-16d6-4fdc-b8a9-c87038bd5197 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5077bfa8-5a67-4be0-b517-a8d712f06d0d req-0066b4b5-16d6-4fdc-b8a9-c87038bd5197 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5077bfa8-5a67-4be0-b517-a8d712f06d0d req-0066b4b5-16d6-4fdc-b8a9-c87038bd5197 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-5077bfa8-5a67-4be0-b517-a8d712f06d0d req-0066b4b5-16d6-4fdc-b8a9-c87038bd5197 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:49:51 user nova-compute[75026]: WARNING nova.compute.manager [req-5077bfa8-5a67-4be0-b517-a8d712f06d0d req-0066b4b5-16d6-4fdc-b8a9-c87038bd5197 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state building and task_state spawning.
Nov 10 19:49:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-4fbbcf11-150f-4fbc-83bd-e26d22cfb77b req-370bc656-ac30-4137-9aaa-2fdadc8fc41b service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4fbbcf11-150f-4fbc-83bd-e26d22cfb77b req-370bc656-ac30-4137-9aaa-2fdadc8fc41b service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4fbbcf11-150f-4fbc-83bd-e26d22cfb77b req-370bc656-ac30-4137-9aaa-2fdadc8fc41b service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4fbbcf11-150f-4fbc-83bd-e26d22cfb77b req-370bc656-ac30-4137-9aaa-2fdadc8fc41b service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-4fbbcf11-150f-4fbc-83bd-e26d22cfb77b req-370bc656-ac30-4137-9aaa-2fdadc8fc41b service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:49:53 user nova-compute[75026]: WARNING nova.compute.manager [req-4fbbcf11-150f-4fbc-83bd-e26d22cfb77b req-370bc656-ac30-4137-9aaa-2fdadc8fc41b service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state building and task_state spawning.
Nov 10 19:49:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-c8a4a938-7493-4ba7-9ee2-5914560179eb req-8fda4d2f-0c80-4e5c-9c13-cb4bb6318c37 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8a4a938-7493-4ba7-9ee2-5914560179eb req-8fda4d2f-0c80-4e5c-9c13-cb4bb6318c37 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8a4a938-7493-4ba7-9ee2-5914560179eb req-8fda4d2f-0c80-4e5c-9c13-cb4bb6318c37 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-c8a4a938-7493-4ba7-9ee2-5914560179eb req-8fda4d2f-0c80-4e5c-9c13-cb4bb6318c37 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-c8a4a938-7493-4ba7-9ee2-5914560179eb req-8fda4d2f-0c80-4e5c-9c13-cb4bb6318c37 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:49:53 user nova-compute[75026]: WARNING nova.compute.manager [req-c8a4a938-7493-4ba7-9ee2-5914560179eb req-8fda4d2f-0c80-4e5c-9c13-cb4bb6318c37 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state building and task_state spawning.
Nov 10 19:49:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:49:55 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance spawned successfully.
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: INFO nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Took 7.77 seconds to spawn the instance on the hypervisor.
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:49:55 user nova-compute[75026]: INFO nova.compute.manager [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Took 8.42 seconds to build instance.
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-5ad89d01-56d2-4cf2-8c42-82b71153133f req-11ad75bb-6a3b-4e8d-a79a-dd91b61d11d2 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5ad89d01-56d2-4cf2-8c42-82b71153133f req-11ad75bb-6a3b-4e8d-a79a-dd91b61d11d2 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5ad89d01-56d2-4cf2-8c42-82b71153133f req-11ad75bb-6a3b-4e8d-a79a-dd91b61d11d2 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5ad89d01-56d2-4cf2-8c42-82b71153133f req-11ad75bb-6a3b-4e8d-a79a-dd91b61d11d2 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-5ad89d01-56d2-4cf2-8c42-82b71153133f req-11ad75bb-6a3b-4e8d-a79a-dd91b61d11d2 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:49:55 user nova-compute[75026]: WARNING nova.compute.manager [req-5ad89d01-56d2-4cf2-8c42-82b71153133f req-11ad75bb-6a3b-4e8d-a79a-dd91b61d11d2 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state building and task_state spawning.
Nov 10 19:49:55 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Instance spawned successfully.
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-eaf36f47-d92d-44cb-a3ff-0ff434d63c12 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.526s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:49:55 user nova-compute[75026]: INFO nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 10 19:49:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:49:55 user nova-compute[75026]: INFO nova.compute.manager [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Took 7.87 seconds to build instance.
Nov 10 19:49:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-264ce6c5-8b51-43fb-84d7-dbca1db54e22 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.980s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:49:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:49:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:50:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:50:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:50:31 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:50:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:50:33 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:50:33 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:50:33 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8344MB free_disk=25.234031677246094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 7991115d-773e-43a2-9a96-0738eea7c7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:50:33 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:50:34 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:50:34 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:50:34 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:50:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:50:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-76697abc-ca4a-4324-b5d4-499c2eb9a7ee req-a0b9c2ea-69d5-45b6-9a3a-d57552a2dcb6 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-changed-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:50:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-76697abc-ca4a-4324-b5d4-499c2eb9a7ee req-a0b9c2ea-69d5-45b6-9a3a-d57552a2dcb6 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Refreshing instance network info cache due to event network-changed-b9ef9cb5-fd20-4741-a044-e0c2728e29c3. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:50:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-76697abc-ca4a-4324-b5d4-499c2eb9a7ee req-a0b9c2ea-69d5-45b6-9a3a-d57552a2dcb6 service nova] Acquiring lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:50:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-76697abc-ca4a-4324-b5d4-499c2eb9a7ee req-a0b9c2ea-69d5-45b6-9a3a-d57552a2dcb6 service nova] Acquired lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:50:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-76697abc-ca4a-4324-b5d4-499c2eb9a7ee req-a0b9c2ea-69d5-45b6-9a3a-d57552a2dcb6 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Refreshing network info cache for port b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:50:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-76697abc-ca4a-4324-b5d4-499c2eb9a7ee req-a0b9c2ea-69d5-45b6-9a3a-d57552a2dcb6 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updated VIF entry in instance network info cache for port b9ef9cb5-fd20-4741-a044-e0c2728e29c3. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:50:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-76697abc-ca4a-4324-b5d4-499c2eb9a7ee req-a0b9c2ea-69d5-45b6-9a3a-d57552a2dcb6 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:50:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-76697abc-ca4a-4324-b5d4-499c2eb9a7ee req-a0b9c2ea-69d5-45b6-9a3a-d57552a2dcb6 service nova] Releasing lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:50:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:50:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:50:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:50:46 user nova-compute[75026]: INFO nova.compute.manager [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Shelving
Nov 10 19:50:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca052459-8a1a-4c22-a5b8-5cc0419ca847 req-85cfda20-8cc1-4f5e-8f70-24f3526cebed service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-unplugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca052459-8a1a-4c22-a5b8-5cc0419ca847 req-85cfda20-8cc1-4f5e-8f70-24f3526cebed service nova] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca052459-8a1a-4c22-a5b8-5cc0419ca847 req-85cfda20-8cc1-4f5e-8f70-24f3526cebed service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca052459-8a1a-4c22-a5b8-5cc0419ca847 req-85cfda20-8cc1-4f5e-8f70-24f3526cebed service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:50:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca052459-8a1a-4c22-a5b8-5cc0419ca847 req-85cfda20-8cc1-4f5e-8f70-24f3526cebed service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] No waiting events found dispatching network-vif-unplugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:50:46 user nova-compute[75026]: WARNING nova.compute.manager [req-ca052459-8a1a-4c22-a5b8-5cc0419ca847 req-85cfda20-8cc1-4f5e-8f70-24f3526cebed service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received unexpected event network-vif-unplugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 for instance with vm_state active and task_state shelving.
Nov 10 19:50:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance destroyed successfully.
Nov 10 19:50:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Beginning cold snapshot process
Nov 10 19:50:47 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:50:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk /opt/stack/data/nova/instances/snapshots/tmpx83audl3/49b2eac20a224a89a099d080f59dc563 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:50:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk /opt/stack/data/nova/instances/snapshots/tmpx83audl3/49b2eac20a224a89a099d080f59dc563" returned: 0 in 1.016s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:50:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Snapshot extracted, beginning image upload
Nov 10 19:50:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-881e06bd-5e6c-4288-8b1f-de822c459a78 req-1bf50aeb-f98b-4da7-a56e-7987058fd297 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:50:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-881e06bd-5e6c-4288-8b1f-de822c459a78 req-1bf50aeb-f98b-4da7-a56e-7987058fd297 service nova] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:50:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-881e06bd-5e6c-4288-8b1f-de822c459a78 req-1bf50aeb-f98b-4da7-a56e-7987058fd297 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:50:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-881e06bd-5e6c-4288-8b1f-de822c459a78 req-1bf50aeb-f98b-4da7-a56e-7987058fd297 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:50:48 user nova-compute[75026]: DEBUG nova.compute.manager [req-881e06bd-5e6c-4288-8b1f-de822c459a78 req-1bf50aeb-f98b-4da7-a56e-7987058fd297 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] No waiting events found dispatching network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:50:48 user nova-compute[75026]: WARNING nova.compute.manager [req-881e06bd-5e6c-4288-8b1f-de822c459a78 req-1bf50aeb-f98b-4da7-a56e-7987058fd297 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received unexpected event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 19:50:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:51 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Snapshot image upload complete
Nov 10 19:50:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:50:51 user nova-compute[75026]: INFO nova.compute.manager [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Shelve offloading
Nov 10 19:50:51 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance destroyed successfully.
Nov 10 19:50:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:50:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:50:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquired lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:50:51 user nova-compute[75026]: DEBUG nova.network.neutron [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:50:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:51 user nova-compute[75026]: DEBUG nova.network.neutron [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:50:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Releasing lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:50:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance destroyed successfully.
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.objects.instance [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'resources' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-908037026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-908037026',id=42,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIE1AtIt3kfTXM1U33jFPmfw8t4446A5GGx+ewqUknZgYlW/S9kG4yNVkxxN9+I6B0yYJVurvEn2AFRqt5Iqlwou9A9x/pA+qnM4fSat4ZcgHTQTxFELYbnUDGZ2W6rUA==',key_name='tempest-keypair-248868573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-fq6p8jz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member',shelved_at='2023-11-10T19:50:51.097210',shelved_host='user',shelved_image_id='e76bd5a5-7514-4aae-8ca8-fc6ae330033f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=0f6ce7f9-77b9-4eaa-be26-d3a744b62998,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG os_vif [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-3f885fd5-ed0a-498e-9d05-46414a23584e req-38270d55-7b01-447f-ba38-628b3b564609 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-changed-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.compute.manager [req-3f885fd5-ed0a-498e-9d05-46414a23584e req-38270d55-7b01-447f-ba38-628b3b564609 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Refreshing instance network info cache due to event network-changed-b9ef9cb5-fd20-4741-a044-e0c2728e29c3. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f885fd5-ed0a-498e-9d05-46414a23584e req-38270d55-7b01-447f-ba38-628b3b564609 service nova] Acquiring lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f885fd5-ed0a-498e-9d05-46414a23584e req-38270d55-7b01-447f-ba38-628b3b564609 service nova] Acquired lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.network.neutron [req-3f885fd5-ed0a-498e-9d05-46414a23584e req-38270d55-7b01-447f-ba38-628b3b564609 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Refreshing network info cache for port b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9ef9cb5-fd, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8e0b58d-75d2-410f-a500-0f31154fe202) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:50:52 user nova-compute[75026]: INFO os_vif [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd')
Nov 10 19:50:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Deleting instance files /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998_del
Nov 10 19:50:52 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Deletion of /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998_del complete
Nov 10 19:50:52 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Deleted allocations for instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998
Nov 10 19:50:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.objects.instance [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.objects.base [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<0f6ce7f9-77b9-4eaa-be26-d3a744b62998> lazy-loaded attributes: resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.network.neutron [req-3f885fd5-ed0a-498e-9d05-46414a23584e req-38270d55-7b01-447f-ba38-628b3b564609 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updated VIF entry in instance network info cache for port b9ef9cb5-fd20-4741-a044-e0c2728e29c3. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG nova.network.neutron [req-3f885fd5-ed0a-498e-9d05-46414a23584e req-38270d55-7b01-447f-ba38-628b3b564609 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3f885fd5-ed0a-498e-9d05-46414a23584e req-38270d55-7b01-447f-ba38-628b3b564609 service nova] Releasing lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:50:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-dd980d24-91c3-4d8a-8a82-566f158cc238 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.487s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:50:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:50:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:51:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:51:17 user nova-compute[75026]: INFO nova.compute.claims [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Claim successful on node user
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:51:17 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:51:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.policy [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '266d44e9c0204bbba57e1148892645e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d70df1f04741f8bb54ea94e932783a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:51:17 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Creating image(s)
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "/opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "/opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk 1073741824" returned: 0 in 0.052s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:17 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Successfully created port: 7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.195s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Cannot resize image /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Ensure instance console log exists: /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Successfully updated port: 7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquired lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-830f1e10-9d34-4489-8afe-b2af6be79545 req-4945c098-697b-45ba-b7e4-7b70192e5092 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-changed-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-830f1e10-9d34-4489-8afe-b2af6be79545 req-4945c098-697b-45ba-b7e4-7b70192e5092 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Refreshing instance network info cache due to event network-changed-7cad14c8-45e1-428b-9e60-1416eb8c3574. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-830f1e10-9d34-4489-8afe-b2af6be79545 req-4945c098-697b-45ba-b7e4-7b70192e5092 service nova] Acquiring lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:51:18 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating instance_info_cache with network_info: [{"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Releasing lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Instance network_info: |[{"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-830f1e10-9d34-4489-8afe-b2af6be79545 req-4945c098-697b-45ba-b7e4-7b70192e5092 service nova] Acquired lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-830f1e10-9d34-4489-8afe-b2af6be79545 req-4945c098-697b-45ba-b7e4-7b70192e5092 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Refreshing network info cache for port 7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Start _get_guest_xml network_info=[{"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:51:19 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:51:19 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1902786107',display_name='tempest-SnapshotDataIntegrityTests-server-1902786107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1902786107',id=45,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjViPZduKPaCSfWEG1ufsuZ7oziTvICQJWe3MmE5r3/LyYoGlIgKfWw4QdS4276YosEhq+8EGOKejtQQlBxQ9xrsNq3l4U9tSxLbEd1K+Qc/ZbFrhgA8fIE6Mf+4vM9xQ==',key_name='tempest-keypair-569837065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43d70df1f04741f8bb54ea94e932783a',ramdisk_id='',reservation_id='r-hqi4tf9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1335929358',owner_user_name='tempest-SnapshotDataIntegrityTests-1335929358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='266d44e9c0204bbba57e1148892645e2',uuid=3d852683-d701-472f-a089-ce5742ba3802,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Converting VIF {"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c9:a3,bridge_name='br-int',has_traffic_filtering=True,id=7cad14c8-45e1-428b-9e60-1416eb8c3574,network=Network(21fb66d1-18c5-48a4-8302-9cc47276a42a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cad14c8-45') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:51:19 user nova-compute[75026]:   <uuid>3d852683-d701-472f-a089-ce5742ba3802</uuid>
Nov 10 19:51:19 user nova-compute[75026]:   <name>instance-0000002d</name>
Nov 10 19:51:19 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:51:19 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:51:19 user nova-compute[75026]:   <metadata>
Nov 10 19:51:19 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:51:19 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:51:19 user nova-compute[75026]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1902786107</nova:name>
Nov 10 19:51:19 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:51:19</nova:creationTime>
Nov 10 19:51:19 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:51:19 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:51:19 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:51:19 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:51:19 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:51:19 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:51:19 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:51:19 user nova-compute[75026]:       <nova:owner>
Nov 10 19:51:19 user nova-compute[75026]:         <nova:user uuid="266d44e9c0204bbba57e1148892645e2">tempest-SnapshotDataIntegrityTests-1335929358-project-member</nova:user>
Nov 10 19:51:19 user nova-compute[75026]:         <nova:project uuid="43d70df1f04741f8bb54ea94e932783a">tempest-SnapshotDataIntegrityTests-1335929358</nova:project>
Nov 10 19:51:19 user nova-compute[75026]:       </nova:owner>
Nov 10 19:51:19 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:51:19 user nova-compute[75026]:       <nova:ports>
Nov 10 19:51:19 user nova-compute[75026]:         <nova:port uuid="7cad14c8-45e1-428b-9e60-1416eb8c3574">
Nov 10 19:51:19 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:51:19 user nova-compute[75026]:         </nova:port>
Nov 10 19:51:19 user nova-compute[75026]:       </nova:ports>
Nov 10 19:51:19 user nova-compute[75026]:     </nova:instance>
Nov 10 19:51:19 user nova-compute[75026]:   </metadata>
Nov 10 19:51:19 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:51:19 user nova-compute[75026]:     <system>
Nov 10 19:51:19 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:51:19 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:51:19 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:51:19 user nova-compute[75026]:       <entry name="serial">3d852683-d701-472f-a089-ce5742ba3802</entry>
Nov 10 19:51:19 user nova-compute[75026]:       <entry name="uuid">3d852683-d701-472f-a089-ce5742ba3802</entry>
Nov 10 19:51:19 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:51:19 user nova-compute[75026]:     </system>
Nov 10 19:51:19 user nova-compute[75026]:   </sysinfo>
Nov 10 19:51:19 user nova-compute[75026]:   <os>
Nov 10 19:51:19 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:51:19 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:51:19 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:51:19 user nova-compute[75026]:   </os>
Nov 10 19:51:19 user nova-compute[75026]:   <features>
Nov 10 19:51:19 user nova-compute[75026]:     <acpi/>
Nov 10 19:51:19 user nova-compute[75026]:     <apic/>
Nov 10 19:51:19 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:51:19 user nova-compute[75026]:   </features>
Nov 10 19:51:19 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:51:19 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:51:19 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:51:19 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:51:19 user nova-compute[75026]:   </clock>
Nov 10 19:51:19 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:51:19 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:51:19 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:51:19 user nova-compute[75026]:   </cpu>
Nov 10 19:51:19 user nova-compute[75026]:   <devices>
Nov 10 19:51:19 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:51:19 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:51:19 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk"/>
Nov 10 19:51:19 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:51:19 user nova-compute[75026]:     </disk>
Nov 10 19:51:19 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:51:19 user nova-compute[75026]:       <mac address="fa:16:3e:4f:c9:a3"/>
Nov 10 19:51:19 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:51:19 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:51:19 user nova-compute[75026]:       <target dev="tap7cad14c8-45"/>
Nov 10 19:51:19 user nova-compute[75026]:     </interface>
Nov 10 19:51:19 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:51:19 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/console.log" append="off"/>
Nov 10 19:51:19 user nova-compute[75026]:     </serial>
Nov 10 19:51:19 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:51:19 user nova-compute[75026]:     <video>
Nov 10 19:51:19 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:51:19 user nova-compute[75026]:     </video>
Nov 10 19:51:19 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:51:19 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:51:19 user nova-compute[75026]:     </rng>
Nov 10 19:51:19 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:51:19 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:51:19 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:51:19 user nova-compute[75026]:     </memballoon>
Nov 10 19:51:19 user nova-compute[75026]:   </devices>
Nov 10 19:51:19 user nova-compute[75026]: </domain>
Nov 10 19:51:19 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1902786107',display_name='tempest-SnapshotDataIntegrityTests-server-1902786107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1902786107',id=45,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjViPZduKPaCSfWEG1ufsuZ7oziTvICQJWe3MmE5r3/LyYoGlIgKfWw4QdS4276YosEhq+8EGOKejtQQlBxQ9xrsNq3l4U9tSxLbEd1K+Qc/ZbFrhgA8fIE6Mf+4vM9xQ==',key_name='tempest-keypair-569837065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43d70df1f04741f8bb54ea94e932783a',ramdisk_id='',reservation_id='r-hqi4tf9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1335929358',owner_user_name='tempest-SnapshotDataIntegrityTests-1335929358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='266d44e9c0204bbba57e1148892645e2',uuid=3d852683-d701-472f-a089-ce5742ba3802,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Converting VIF {"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c9:a3,bridge_name='br-int',has_traffic_filtering=True,id=7cad14c8-45e1-428b-9e60-1416eb8c3574,network=Network(21fb66d1-18c5-48a4-8302-9cc47276a42a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cad14c8-45') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG os_vif [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c9:a3,bridge_name='br-int',has_traffic_filtering=True,id=7cad14c8-45e1-428b-9e60-1416eb8c3574,network=Network(21fb66d1-18c5-48a4-8302-9cc47276a42a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cad14c8-45') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67629719-6393-5451-b90f-4681f92c0781', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cad14c8-45, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cad14c8-45, col_values=(('qos', UUID('8b7474bc-11eb-43ba-9e1e-0011797f57c8')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cad14c8-45, col_values=(('external_ids', {'iface-id': '7cad14c8-45e1-428b-9e60-1416eb8c3574', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:c9:a3', 'vm-uuid': '3d852683-d701-472f-a089-ce5742ba3802'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:19 user nova-compute[75026]: INFO os_vif [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c9:a3,bridge_name='br-int',has_traffic_filtering=True,id=7cad14c8-45e1-428b-9e60-1416eb8c3574,network=Network(21fb66d1-18c5-48a4-8302-9cc47276a42a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cad14c8-45')
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No VIF found with MAC fa:16:3e:4f:c9:a3, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-830f1e10-9d34-4489-8afe-b2af6be79545 req-4945c098-697b-45ba-b7e4-7b70192e5092 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updated VIF entry in instance network info cache for port 7cad14c8-45e1-428b-9e60-1416eb8c3574. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-830f1e10-9d34-4489-8afe-b2af6be79545 req-4945c098-697b-45ba-b7e4-7b70192e5092 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating instance_info_cache with network_info: [{"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:51:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-830f1e10-9d34-4489-8afe-b2af6be79545 req-4945c098-697b-45ba-b7e4-7b70192e5092 service nova] Releasing lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:51:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-38bda201-5d59-4ba6-a5f5-435afc12763d req-b953706f-9b3e-4a03-955a-1880712af666 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-38bda201-5d59-4ba6-a5f5-435afc12763d req-b953706f-9b3e-4a03-955a-1880712af666 service nova] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-38bda201-5d59-4ba6-a5f5-435afc12763d req-b953706f-9b3e-4a03-955a-1880712af666 service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-38bda201-5d59-4ba6-a5f5-435afc12763d req-b953706f-9b3e-4a03-955a-1880712af666 service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-38bda201-5d59-4ba6-a5f5-435afc12763d req-b953706f-9b3e-4a03-955a-1880712af666 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] No waiting events found dispatching network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:20 user nova-compute[75026]: WARNING nova.compute.manager [req-38bda201-5d59-4ba6-a5f5-435afc12763d req-b953706f-9b3e-4a03-955a-1880712af666 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received unexpected event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 for instance with vm_state building and task_state spawning.
Nov 10 19:51:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:22 user nova-compute[75026]: DEBUG nova.compute.manager [req-26e952de-4642-49e0-88cf-a751acff5b1e req-8761301a-2669-4d0a-b4f0-dc005b8ff899 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26e952de-4642-49e0-88cf-a751acff5b1e req-8761301a-2669-4d0a-b4f0-dc005b8ff899 service nova] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26e952de-4642-49e0-88cf-a751acff5b1e req-8761301a-2669-4d0a-b4f0-dc005b8ff899 service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26e952de-4642-49e0-88cf-a751acff5b1e req-8761301a-2669-4d0a-b4f0-dc005b8ff899 service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-26e952de-4642-49e0-88cf-a751acff5b1e req-8761301a-2669-4d0a-b4f0-dc005b8ff899 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] No waiting events found dispatching network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:23 user nova-compute[75026]: WARNING nova.compute.manager [req-26e952de-4642-49e0-88cf-a751acff5b1e req-8761301a-2669-4d0a-b4f0-dc005b8ff899 service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received unexpected event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 for instance with vm_state building and task_state spawning.
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:51:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Instance spawned successfully.
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:51:23 user nova-compute[75026]: INFO nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 10 19:51:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:51:23 user nova-compute[75026]: INFO nova.compute.manager [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Took 6.30 seconds to build instance.
Nov 10 19:51:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f7556c27-d993-49ba-af2f-166175b4c577 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.406s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-f14e2a48-1318-47e4-80ad-fa03aa82f4b3 req-16ea2bba-fae1-4c54-835b-da35bc93b25b service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-f14e2a48-1318-47e4-80ad-fa03aa82f4b3 req-16ea2bba-fae1-4c54-835b-da35bc93b25b service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing instance network info cache due to event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f14e2a48-1318-47e4-80ad-fa03aa82f4b3 req-16ea2bba-fae1-4c54-835b-da35bc93b25b service nova] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f14e2a48-1318-47e4-80ad-fa03aa82f4b3 req-16ea2bba-fae1-4c54-835b-da35bc93b25b service nova] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-f14e2a48-1318-47e4-80ad-fa03aa82f4b3 req-16ea2bba-fae1-4c54-835b-da35bc93b25b service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-f14e2a48-1318-47e4-80ad-fa03aa82f4b3 req-16ea2bba-fae1-4c54-835b-da35bc93b25b service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updated VIF entry in instance network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-f14e2a48-1318-47e4-80ad-fa03aa82f4b3 req-16ea2bba-fae1-4c54-835b-da35bc93b25b service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:51:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f14e2a48-1318-47e4-80ad-fa03aa82f4b3 req-16ea2bba-fae1-4c54-835b-da35bc93b25b service nova] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-fa05b0a9-542d-494d-ab93-593c0fdd796f req-9a865307-e956-4154-8c6f-0a55de1c7036 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-fa05b0a9-542d-494d-ab93-593c0fdd796f req-9a865307-e956-4154-8c6f-0a55de1c7036 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing instance network info cache due to event network-changed-4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fa05b0a9-542d-494d-ab93-593c0fdd796f req-9a865307-e956-4154-8c6f-0a55de1c7036 service nova] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fa05b0a9-542d-494d-ab93-593c0fdd796f req-9a865307-e956-4154-8c6f-0a55de1c7036 service nova] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.network.neutron [req-fa05b0a9-542d-494d-ab93-593c0fdd796f req-9a865307-e956-4154-8c6f-0a55de1c7036 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Refreshing network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:28 user nova-compute[75026]: INFO nova.compute.manager [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Detaching volume dbba4835-ee64-4c61-aa65-c8b6703c3630
Nov 10 19:51:28 user nova-compute[75026]: INFO nova.virt.block_device [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Attempting to driver detach volume dbba4835-ee64-4c61-aa65-c8b6703c3630 from mountpoint /dev/vdb
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Attempting to detach device vdb from instance 7991115d-773e-43a2-9a96-0738eea7c7aa from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:51:28 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:51:28 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:51:28 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:51:28 user nova-compute[75026]:   <serial>dbba4835-ee64-4c61-aa65-c8b6703c3630</serial>
Nov 10 19:51:28 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:51:28 user nova-compute[75026]: </disk>
Nov 10 19:51:28 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:51:28 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully detached device vdb from instance 7991115d-773e-43a2-9a96-0738eea7c7aa from the persistent domain config.
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7991115d-773e-43a2-9a96-0738eea7c7aa from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:51:28 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:51:28 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:51:28 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:51:28 user nova-compute[75026]:   <serial>dbba4835-ee64-4c61-aa65-c8b6703c3630</serial>
Nov 10 19:51:28 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:51:28 user nova-compute[75026]: </disk>
Nov 10 19:51:28 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.network.neutron [req-fa05b0a9-542d-494d-ab93-593c0fdd796f req-9a865307-e956-4154-8c6f-0a55de1c7036 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updated VIF entry in instance network info cache for port 4e16e510-36df-416a-96ae-7e9227f9e146. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.network.neutron [req-fa05b0a9-542d-494d-ab93-593c0fdd796f req-9a865307-e956-4154-8c6f-0a55de1c7036 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fa05b0a9-542d-494d-ab93-593c0fdd796f req-9a865307-e956-4154-8c6f-0a55de1c7036 service nova] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:51:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7991115d-773e-43a2-9a96-0738eea7c7aa {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:51:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:32 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:51:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:34 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:51:34 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:51:34 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8432MB free_disk=25.208614349365234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 7991115d-773e-43a2-9a96-0738eea7c7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:51:34 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:51:35 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:51:35 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:51:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 7991115d-773e-43a2-9a96-0738eea7c7aa {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [{"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-7991115d-773e-43a2-9a96-0738eea7c7aa" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:37 user nova-compute[75026]: INFO nova.compute.manager [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Rescuing
Nov 10 19:51:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:51:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquired lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:51:37 user nova-compute[75026]: DEBUG nova.network.neutron [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updating instance_info_cache with network_info: [{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Releasing lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa9bd61c-0f54-458a-aed2-75c2612269e5 req-510ace51-144c-4f1e-a8f9-fee6af00253e service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa9bd61c-0f54-458a-aed2-75c2612269e5 req-510ace51-144c-4f1e-a8f9-fee6af00253e service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa9bd61c-0f54-458a-aed2-75c2612269e5 req-510ace51-144c-4f1e-a8f9-fee6af00253e service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa9bd61c-0f54-458a-aed2-75c2612269e5 req-510ace51-144c-4f1e-a8f9-fee6af00253e service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa9bd61c-0f54-458a-aed2-75c2612269e5 req-510ace51-144c-4f1e-a8f9-fee6af00253e service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:38 user nova-compute[75026]: WARNING nova.compute.manager [req-aa9bd61c-0f54-458a-aed2-75c2612269e5 req-510ace51-144c-4f1e-a8f9-fee6af00253e service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state active and task_state rescuing.
Nov 10 19:51:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Instance destroyed successfully.
Nov 10 19:51:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Attempting rescue
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Instance directory exists: not creating {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 19:51:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Creating image(s)
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue" returned: 0 in 0.058s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'migration_context' on Instance uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.base [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<1d69dbab-693c-462e-b8e9-d53a4e311e30> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Start _get_guest_xml network_info=[{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:da:5a:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'resources' on Instance uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.base [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<1d69dbab-693c-462e-b8e9-d53a4e311e30> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.base [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<1d69dbab-693c-462e-b8e9-d53a4e311e30> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:51:39 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:51:39 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.base [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<1d69dbab-693c-462e-b8e9-d53a4e311e30> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1152529874',display_name='tempest-ServerRescueNegativeTestJSON-server-1152529874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1152529874',id=44,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-omi3z18y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:49:56Z,user_data=None,user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=1d69dbab-693c-462e-b8e9-d53a4e311e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:da:5a:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:da:5a:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=b4dac984-0d9c-4ce9-9024-7ce2f87e4048,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dac984-0d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.objects.base [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<1d69dbab-693c-462e-b8e9-d53a4e311e30> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:51:39 user nova-compute[75026]:   <uuid>1d69dbab-693c-462e-b8e9-d53a4e311e30</uuid>
Nov 10 19:51:39 user nova-compute[75026]:   <name>instance-0000002c</name>
Nov 10 19:51:39 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:51:39 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:51:39 user nova-compute[75026]:   <metadata>
Nov 10 19:51:39 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:51:39 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:51:39 user nova-compute[75026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1152529874</nova:name>
Nov 10 19:51:39 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:51:39</nova:creationTime>
Nov 10 19:51:39 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:51:39 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:51:39 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:51:39 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:51:39 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:51:39 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:51:39 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:51:39 user nova-compute[75026]:       <nova:owner>
Nov 10 19:51:39 user nova-compute[75026]:         <nova:user uuid="b7ef73abaece4f08b00d81d403a8a66a">tempest-ServerRescueNegativeTestJSON-1130240525-project-member</nova:user>
Nov 10 19:51:39 user nova-compute[75026]:         <nova:project uuid="64d8f446a3094348839f9216faff0485">tempest-ServerRescueNegativeTestJSON-1130240525</nova:project>
Nov 10 19:51:39 user nova-compute[75026]:       </nova:owner>
Nov 10 19:51:39 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:51:39 user nova-compute[75026]:       <nova:ports>
Nov 10 19:51:39 user nova-compute[75026]:         <nova:port uuid="b4dac984-0d9c-4ce9-9024-7ce2f87e4048">
Nov 10 19:51:39 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 19:51:39 user nova-compute[75026]:         </nova:port>
Nov 10 19:51:39 user nova-compute[75026]:       </nova:ports>
Nov 10 19:51:39 user nova-compute[75026]:     </nova:instance>
Nov 10 19:51:39 user nova-compute[75026]:   </metadata>
Nov 10 19:51:39 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:51:39 user nova-compute[75026]:     <system>
Nov 10 19:51:39 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:51:39 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:51:39 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:51:39 user nova-compute[75026]:       <entry name="serial">1d69dbab-693c-462e-b8e9-d53a4e311e30</entry>
Nov 10 19:51:39 user nova-compute[75026]:       <entry name="uuid">1d69dbab-693c-462e-b8e9-d53a4e311e30</entry>
Nov 10 19:51:39 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:51:39 user nova-compute[75026]:     </system>
Nov 10 19:51:39 user nova-compute[75026]:   </sysinfo>
Nov 10 19:51:39 user nova-compute[75026]:   <os>
Nov 10 19:51:39 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:51:39 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:51:39 user nova-compute[75026]:   </os>
Nov 10 19:51:39 user nova-compute[75026]:   <features>
Nov 10 19:51:39 user nova-compute[75026]:     <acpi/>
Nov 10 19:51:39 user nova-compute[75026]:     <apic/>
Nov 10 19:51:39 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:51:39 user nova-compute[75026]:   </features>
Nov 10 19:51:39 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:51:39 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:51:39 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:51:39 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:51:39 user nova-compute[75026]:   </clock>
Nov 10 19:51:39 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:51:39 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:51:39 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:51:39 user nova-compute[75026]:   </cpu>
Nov 10 19:51:39 user nova-compute[75026]:   <devices>
Nov 10 19:51:39 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:51:39 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:51:39 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue"/>
Nov 10 19:51:39 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:51:39 user nova-compute[75026]:     </disk>
Nov 10 19:51:39 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:51:39 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:51:39 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk"/>
Nov 10 19:51:39 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:51:39 user nova-compute[75026]:     </disk>
Nov 10 19:51:39 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:51:39 user nova-compute[75026]:       <mac address="fa:16:3e:da:5a:01"/>
Nov 10 19:51:39 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:51:39 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:51:39 user nova-compute[75026]:       <target dev="tapb4dac984-0d"/>
Nov 10 19:51:39 user nova-compute[75026]:     </interface>
Nov 10 19:51:39 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:51:39 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/console.log" append="off"/>
Nov 10 19:51:39 user nova-compute[75026]:     </serial>
Nov 10 19:51:39 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:51:39 user nova-compute[75026]:     <video>
Nov 10 19:51:39 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:51:39 user nova-compute[75026]:     </video>
Nov 10 19:51:39 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:51:39 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:51:39 user nova-compute[75026]:     </rng>
Nov 10 19:51:39 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:51:39 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:51:39 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:51:39 user nova-compute[75026]:     </memballoon>
Nov 10 19:51:39 user nova-compute[75026]:   </devices>
Nov 10 19:51:39 user nova-compute[75026]: </domain>
Nov 10 19:51:39 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:51:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Instance destroyed successfully.
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No VIF found with MAC fa:16:3e:da:5a:01, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:40 user nova-compute[75026]: WARNING nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state active and task_state rescuing.
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:40 user nova-compute[75026]: WARNING nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state active and task_state rescuing.
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:40 user nova-compute[75026]: WARNING nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state active and task_state rescuing.
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:40 user nova-compute[75026]: WARNING nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state active and task_state rescuing.
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:40 user nova-compute[75026]: WARNING nova.compute.manager [req-70d02bda-fa4c-4d02-8442-ee349e5e12f3 req-af957781-1c7f-43d5-9019-e452a1d9f071 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state active and task_state rescuing.
Nov 10 19:51:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:42 user nova-compute[75026]: WARNING nova.compute.manager [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state active and task_state rescuing.
Nov 10 19:51:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:42 user nova-compute[75026]: DEBUG nova.compute.manager [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:51:42 user nova-compute[75026]: WARNING nova.compute.manager [req-214e831a-3020-4870-a6e5-6f1f8a8fa0ee req-f1038bf6-0b71-4a20-93d7-6a4f9175abc7 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state active and task_state rescuing.
Nov 10 19:51:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-431fc9be-bec4-4b91-ab5a-1be5b0d21a80 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:51:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:48 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7991115d-773e-43a2-9a96-0738eea7c7aa is timed out.
Nov 10 19:51:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully detached device vdb from instance 7991115d-773e-43a2-9a96-0738eea7c7aa from the live domain config.
Nov 10 19:51:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBZOTWUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:51:48 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:51:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[836ca336-d54a-4e55-b0b1-d61600225c6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:51:48 user nova-compute[75026]: No targets found.
Nov 10 19:51:48 user nova-compute[75026]: iSNS:
Nov 10 19:51:48 user nova-compute[75026]: No targets found.
Nov 10 19:51:48 user nova-compute[75026]: STATIC:
Nov 10 19:51:48 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630
Nov 10 19:51:48 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:51:48 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:51:48 user nova-compute[75026]: FIRMWARE:
Nov 10 19:51:48 user nova-compute[75026]: No targets found.
Nov 10 19:51:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:51:48 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:51:48 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:51:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb29a833-e5ed-4a13-893d-86e4cf874517]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e8e784-cd20-425b-94b5-fd606ff03d75]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 (non-flash)
Nov 10 19:51:49 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 (non-flash)
Nov 10 19:51:49 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed983b8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dd5f28-c7cf-4b5a-b9e1-ffb481218127]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8daa9ed-abbf-4a66-ab1e-42dac706318d]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6b36e6-4136-4fcb-bbdf-dc2871d2a4da]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3c6b58-782d-43e6-bbf1-95af7d9e493c]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[86303d47-8612-49cb-8ad4-31e20ae065a3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc02f9a1-2a59-4585-a297-dda4bea1d291]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630, portal: 172.16.0.220,3260]
Nov 10 19:51:49 user nova-compute[75026]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630, portal: 172.16.0.220,3260] successful.
Nov 10 19:51:49 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbba4835-ee64-4c61-aa65-c8b6703c3630 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[280d6341-32f8-483d-9fa8-8c2dd80dee08]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] <== disconnect_volume: return (306ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:51:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:50 user nova-compute[75026]: DEBUG nova.objects.instance [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'flavor' on Instance uuid 7991115d-773e-43a2-9a96-0738eea7c7aa {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:51:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-78fee66f-76c1-4c03-8afe-e401a0645ac2 tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Verify base images {{(pid=75026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Image id da817026-309f-4431-a8d4-b6d8e64853b2 yields fingerprint 5d11e5e638bf2a7e50dbec3264137c01ca9509dd {{(pid=75026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 19:51:56 user nova-compute[75026]: INFO nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] image da817026-309f-4431-a8d4-b6d8e64853b2 at (/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd): checking
Nov 10 19:51:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] image da817026-309f-4431-a8d4-b6d8e64853b2 at (/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd): image is in use {{(pid=75026) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Image id 12c435ae-4307-4c0f-8493-cfd0a1cf4afb yields fingerprint 3dab6f263d96fda3e3988b32da16290d8b9ec067 {{(pid=75026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 19:51:56 user nova-compute[75026]: INFO nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] image 12c435ae-4307-4c0f-8493-cfd0a1cf4afb at (/opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067): checking
Nov 10 19:51:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] image 12c435ae-4307-4c0f-8493-cfd0a1cf4afb at (/opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067): image is in use {{(pid=75026) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] 7991115d-773e-43a2-9a96-0738eea7c7aa is a valid instance name {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] 7991115d-773e-43a2-9a96-0738eea7c7aa has a disk file {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 19:51:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 7991115d-773e-43a2-9a96-0738eea7c7aa is backed by 3dab6f263d96fda3e3988b32da16290d8b9ec067 {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] 1d69dbab-693c-462e-b8e9-d53a4e311e30 is a valid instance name {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] 1d69dbab-693c-462e-b8e9-d53a4e311e30 has a disk file {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 is backed by 5d11e5e638bf2a7e50dbec3264137c01ca9509dd {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] 3d852683-d701-472f-a089-ce5742ba3802 is a valid instance name {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] 3d852683-d701-472f-a089-ce5742ba3802 has a disk file {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 is backed by 5d11e5e638bf2a7e50dbec3264137c01ca9509dd {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] 39176d38-43bf-49b4-8f64-cd16b5ada8a7 is a valid instance name {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] 39176d38-43bf-49b4-8f64-cd16b5ada8a7 has a disk file {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 is backed by 5d11e5e638bf2a7e50dbec3264137c01ca9509dd {{(pid=75026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 19:51:57 user nova-compute[75026]: WARNING nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160
Nov 10 19:51:57 user nova-compute[75026]: WARNING nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2
Nov 10 19:51:57 user nova-compute[75026]: WARNING nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3
Nov 10 19:51:57 user nova-compute[75026]: WARNING nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9
Nov 10 19:51:57 user nova-compute[75026]: INFO nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Active base files: /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd /opt/stack/data/nova/instances/_base/3dab6f263d96fda3e3988b32da16290d8b9ec067
Nov 10 19:51:57 user nova-compute[75026]: INFO nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Removable base files: /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160 /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2 /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3 /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9
Nov 10 19:51:57 user nova-compute[75026]: INFO nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c9ce355cc23e36dab2e8d69d0cfe8c32a118b160
Nov 10 19:51:57 user nova-compute[75026]: INFO nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ce87b9a3139dcdc3f7c39d6c4f60edcb5495feb2
Nov 10 19:51:57 user nova-compute[75026]: INFO nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b3b30942fd25d3ff19ffad3b48b1ea49d9da90e3
Nov 10 19:51:57 user nova-compute[75026]: INFO nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2ad7e4e8a1f55ca5c93e7cdc41b9b2f33eac35a9
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Verification complete {{(pid=75026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Verify swap images {{(pid=75026) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 10 19:51:57 user nova-compute[75026]: DEBUG nova.virt.libvirt.imagecache [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Verify ephemeral images {{(pid=75026) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 10 19:51:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:51:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:52:28 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:52:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:52:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:52:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:52:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:52:30 user nova-compute[75026]: INFO nova.compute.manager [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Terminating instance
Nov 10 19:52:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-30b83f13-4a84-4a52-bf51-a74f00a2344c req-755599ef-5fc5-4d18-a81e-4c25848d8632 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-unplugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-30b83f13-4a84-4a52-bf51-a74f00a2344c req-755599ef-5fc5-4d18-a81e-4c25848d8632 service nova] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-30b83f13-4a84-4a52-bf51-a74f00a2344c req-755599ef-5fc5-4d18-a81e-4c25848d8632 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-30b83f13-4a84-4a52-bf51-a74f00a2344c req-755599ef-5fc5-4d18-a81e-4c25848d8632 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-30b83f13-4a84-4a52-bf51-a74f00a2344c req-755599ef-5fc5-4d18-a81e-4c25848d8632 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] No waiting events found dispatching network-vif-unplugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-30b83f13-4a84-4a52-bf51-a74f00a2344c req-755599ef-5fc5-4d18-a81e-4c25848d8632 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-unplugged-4e16e510-36df-416a-96ae-7e9227f9e146 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Instance destroyed successfully.
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.objects.instance [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lazy-loading 'resources' on Instance uuid 7991115d-773e-43a2-9a96-0738eea7c7aa {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-656161008',display_name='tempest-TestMinimumBasicScenario-server-656161008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-656161008',id=41,image_ref='12c435ae-4307-4c0f-8493-cfd0a1cf4afb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+3csZHnUhh75ldKllDaCNfIcRfbY/8tS/W+s6nwLTZV9cSeh7LnO9J3kkzMKOJ2mk798rAebKna3Hl1TzQbI/HbRN8MxbDtXJAYoJtcnrz4m2hbgndvBGrG4IFPjvblQ==',key_name='tempest-TestMinimumBasicScenario-237331585',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:47:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1772dacf6532415e9fad0345cc6b6f8f',ramdisk_id='',reservation_id='r-jr70i0gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='12c435ae-4307-4c0f-8493-cfd0a1cf4afb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-966338622',owner_user_name='tempest-TestMinimumBasicScenario-966338622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:49:42Z,user_data=None,user_id='68746f97690e4928acbcade25680b895',uuid=7991115d-773e-43a2-9a96-0738eea7c7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converting VIF {"id": "4e16e510-36df-416a-96ae-7e9227f9e146", "address": "fa:16:3e:22:9f:01", "network": {"id": "dd35307d-8765-4c34-af16-03fe2f615c38", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-520508522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1772dacf6532415e9fad0345cc6b6f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e16e510-36", "ovs_interfaceid": "4e16e510-36df-416a-96ae-7e9227f9e146", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:9f:01,bridge_name='br-int',has_traffic_filtering=True,id=4e16e510-36df-416a-96ae-7e9227f9e146,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e16e510-36') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG os_vif [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:9f:01,bridge_name='br-int',has_traffic_filtering=True,id=4e16e510-36df-416a-96ae-7e9227f9e146,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e16e510-36') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e16e510-36, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aefc3c5-1d14-4c27-ae52-e34e62433e52) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:52:31 user nova-compute[75026]: INFO os_vif [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:9f:01,bridge_name='br-int',has_traffic_filtering=True,id=4e16e510-36df-416a-96ae-7e9227f9e146,network=Network(dd35307d-8765-4c34-af16-03fe2f615c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e16e510-36')
Nov 10 19:52:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Deleting instance files /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa_del
Nov 10 19:52:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Deletion of /opt/stack/data/nova/instances/7991115d-773e-43a2-9a96-0738eea7c7aa_del complete
Nov 10 19:52:31 user nova-compute[75026]: INFO nova.compute.manager [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 19:52:31 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:32 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:52:32 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Took 0.43 seconds to deallocate network for instance.
Nov 10 19:52:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-25b076fa-3284-4691-81c0-dcdc00f86782 req-3d854ddc-f534-47b9-bf51-3efdc8602831 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-deleted-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:52:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:52:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:52:32 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:52:32 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:52:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:52:32 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Deleted allocations for instance 7991115d-773e-43a2-9a96-0738eea7c7aa
Nov 10 19:52:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-26970086-866a-47ff-bc68-e09fc08b08fb tempest-TestMinimumBasicScenario-966338622 tempest-TestMinimumBasicScenario-966338622-project-member] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.674s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-45d97582-fc3a-44c6-8615-5e2c4ebe453c req-4c4af837-8144-4c1c-b450-7e67fbb55777 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45d97582-fc3a-44c6-8615-5e2c4ebe453c req-4c4af837-8144-4c1c-b450-7e67fbb55777 service nova] Acquiring lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45d97582-fc3a-44c6-8615-5e2c4ebe453c req-4c4af837-8144-4c1c-b450-7e67fbb55777 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-45d97582-fc3a-44c6-8615-5e2c4ebe453c req-4c4af837-8144-4c1c-b450-7e67fbb55777 service nova] Lock "7991115d-773e-43a2-9a96-0738eea7c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-45d97582-fc3a-44c6-8615-5e2c4ebe453c req-4c4af837-8144-4c1c-b450-7e67fbb55777 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] No waiting events found dispatching network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:52:33 user nova-compute[75026]: WARNING nova.compute.manager [req-45d97582-fc3a-44c6-8615-5e2c4ebe453c req-4c4af837-8144-4c1c-b450-7e67fbb55777 service nova] [instance: 7991115d-773e-43a2-9a96-0738eea7c7aa] Received unexpected event network-vif-plugged-4e16e510-36df-416a-96ae-7e9227f9e146 for instance with vm_state deleted and task_state None.
Nov 10 19:52:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:52:33 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:34 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:35 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:52:35 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:52:35 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8545MB free_disk=25.20663833618164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:52:35 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:52:36 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:52:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:52:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:52:38 user nova-compute[75026]: INFO nova.compute.manager [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Unshelving
Nov 10 19:52:38 user nova-compute[75026]: INFO nova.virt.block_device [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Booting with volume 7ea7817a-fa29-45e8-bc63-0789379c46c8 at /dev/vdc
Nov 10 19:52:38 user nova-compute[75026]: DEBUG os_brick.utils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fda96e-a4e5-4fa9-93c7-2ece87722044]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8152e7-d64b-4231-971a-dedcb71975e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[97705a29-e487-4e6f-9849-cae6d6bd88cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fa796e-6fac-4dab-a17d-a666bff30700]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:52:38 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:52:38 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c7c710-a033-46e9-a9a0-fe0aa5993c42]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG os_brick.utils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:52:38 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating existing volume attachment record: e49bf26e-9381-438b-be5c-8abcb59fe58a {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:52:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:52:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:52:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:52:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:52:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:52:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:52:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:02 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'pci_requests' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:02 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:02 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:53:02 user nova-compute[75026]: INFO nova.compute.claims [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Claim successful on node user
Nov 10 19:53:02 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:53:02 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:53:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:02 user nova-compute[75026]: INFO nova.network.neutron [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating port b9ef9cb5-fd20-4741-a044-e0c2728e29c3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquired lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-93fdd397-f50e-4fcb-b7c1-2a4c7948b7a9 req-7884ee83-c158-49c0-85f2-212bad635b0c service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-changed-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-93fdd397-f50e-4fcb-b7c1-2a4c7948b7a9 req-7884ee83-c158-49c0-85f2-212bad635b0c service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Refreshing instance network info cache due to event network-changed-b9ef9cb5-fd20-4741-a044-e0c2728e29c3. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-93fdd397-f50e-4fcb-b7c1-2a4c7948b7a9 req-7884ee83-c158-49c0-85f2-212bad635b0c service nova] Acquiring lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG nova.network.neutron [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Releasing lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:53:03 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Creating image(s)
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-93fdd397-f50e-4fcb-b7c1-2a4c7948b7a9 req-7884ee83-c158-49c0-85f2-212bad635b0c service nova] Acquired lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-93fdd397-f50e-4fcb-b7c1-2a4c7948b7a9 req-7884ee83-c158-49c0-85f2-212bad635b0c service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Refreshing network info cache for port b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG nova.objects.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<0f6ce7f9-77b9-4eaa-be26-d3a744b62998> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "56b56dbedade3c4ec5acafda23ec292e9bf88165" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "56b56dbedade3c4ec5acafda23ec292e9bf88165" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG nova.virt.images [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] e76bd5a5-7514-4aae-8ca8-fc6ae330033f was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165.part /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG nova.network.neutron [req-93fdd397-f50e-4fcb-b7c1-2a4c7948b7a9 req-7884ee83-c158-49c0-85f2-212bad635b0c service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updated VIF entry in instance network info cache for port b9ef9cb5-fd20-4741-a044-e0c2728e29c3. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG nova.network.neutron [req-93fdd397-f50e-4fcb-b7c1-2a4c7948b7a9 req-7884ee83-c158-49c0-85f2-212bad635b0c service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-93fdd397-f50e-4fcb-b7c1-2a4c7948b7a9 req-7884ee83-c158-49c0-85f2-212bad635b0c service nova] Releasing lock "refresh_cache-0f6ce7f9-77b9-4eaa-be26-d3a744b62998" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165.part /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165.converted" returned: 0 in 0.513s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:05 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "56b56dbedade3c4ec5acafda23ec292e9bf88165" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.413s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165 --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "56b56dbedade3c4ec5acafda23ec292e9bf88165" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "56b56dbedade3c4ec5acafda23ec292e9bf88165" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165 --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165,backing_fmt=raw /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165,backing_fmt=raw /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk 1073741824" returned: 0 in 0.048s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "56b56dbedade3c4ec5acafda23ec292e9bf88165" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b56dbedade3c4ec5acafda23ec292e9bf88165 --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'migration_context' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG nova.objects.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<0f6ce7f9-77b9-4eaa-be26-d3a744b62998> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:53:06 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Rebasing disk image.
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd -F raw /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-79312edf-4eef-4d38-8bcf-cc9bbb3cf41d req-413b3e09-2d79-4f1f-9ca4-fc6e5a25083d service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-changed-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:53:08 user nova-compute[75026]: DEBUG nova.compute.manager [req-79312edf-4eef-4d38-8bcf-cc9bbb3cf41d req-413b3e09-2d79-4f1f-9ca4-fc6e5a25083d service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Refreshing instance network info cache due to event network-changed-7cad14c8-45e1-428b-9e60-1416eb8c3574. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:53:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-79312edf-4eef-4d38-8bcf-cc9bbb3cf41d req-413b3e09-2d79-4f1f-9ca4-fc6e5a25083d service nova] Acquiring lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:53:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-79312edf-4eef-4d38-8bcf-cc9bbb3cf41d req-413b3e09-2d79-4f1f-9ca4-fc6e5a25083d service nova] Acquired lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:53:08 user nova-compute[75026]: DEBUG nova.network.neutron [req-79312edf-4eef-4d38-8bcf-cc9bbb3cf41d req-413b3e09-2d79-4f1f-9ca4-fc6e5a25083d service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Refreshing network info cache for port 7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:53:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.network.neutron [req-79312edf-4eef-4d38-8bcf-cc9bbb3cf41d req-413b3e09-2d79-4f1f-9ca4-fc6e5a25083d service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updated VIF entry in instance network info cache for port 7cad14c8-45e1-428b-9e60-1416eb8c3574. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.network.neutron [req-79312edf-4eef-4d38-8bcf-cc9bbb3cf41d req-413b3e09-2d79-4f1f-9ca4-fc6e5a25083d service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating instance_info_cache with network_info: [{"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-79312edf-4eef-4d38-8bcf-cc9bbb3cf41d req-413b3e09-2d79-4f1f-9ca4-fc6e5a25083d service nova] Releasing lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd -F raw /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk" returned: 0 in 2.393s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Ensure instance console log exists: /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Start _get_guest_xml network_info=[{"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='fc74d9c602bd1b58a4545fb26ae91534',container_format='bare',created_at=2023-11-10T19:50:46Z,direct_url=<?>,disk_format='qcow2',id=e76bd5a5-7514-4aae-8ca8-fc6ae330033f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-908037026-shelved',owner='8508550b77e9441e939a122e28f723e5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T19:50:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'e49bf26e-9381-438b-be5c-8abcb59fe58a', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfkEosWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0f6ce7f9-77b9-4eaa-be26-d3a744b62998', 'attached_at': '', 'detached_at': '', 'volume_id': '7ea7817a-fa29-45e8-bc63-0789379c46c8', 'serial': '7ea7817a-fa29-45e8-bc63-0789379c46c8'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:53:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:53:09 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fc74d9c602bd1b58a4545fb26ae91534',container_format='bare',created_at=2023-11-10T19:50:46Z,direct_url=<?>,disk_format='qcow2',id=e76bd5a5-7514-4aae-8ca8-fc6ae330033f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-908037026-shelved',owner='8508550b77e9441e939a122e28f723e5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T19:50:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.objects.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<0f6ce7f9-77b9-4eaa-be26-d3a744b62998> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfkEosWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:53:09 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:53:09 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:53:09 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f59b0f-0d43-4897-acc8-b7c7f7dfc132]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:53:09 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d29af6a-b868-4754-b2b2-6691adbc7431]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8] added
Nov 10 19:53:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[677c16a9-1a17-492a-b5f3-5df876f9a51f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e631af5-4e41-42db-8e7d-fc1159a225f2]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfkEosWT {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfkEosWT" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0b8b58-8c92-4f56-a639-568620deb265]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BfkEosWT'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0d2e66-09f5-4fb3-9e25-881fbb82442a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[033fd270-7cea-49be-9641-3696e2105d62]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:53:09 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:53:09 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:53:09 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:53:09 user nova-compute[75026]: 
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c339ec-97eb-46c5-9e04-42e4d2b62a52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8, portal: 172.16.0.220,3260]
Nov 10 19:53:09 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8, portal: 172.16.0.220,3260] successful.
Nov 10 19:53:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f8be00-4973-422a-9284-e0006cae312c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4741c614-4052-41d0-af6c-8eeed3af6258]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:53:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:53:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab8dd74-3019-4999-8fba-1068505581cb]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:53:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfkEosWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23865303165333935', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865303165333935', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-908037026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-908037026',id=42,image_ref='e76bd5a5-7514-4aae-8ca8-fc6ae330033f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-248868573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-fq6p8jz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member',shelved_at='2023-11-10T19:50:51.097210',shelved_host='user',shelved_image_id='e76bd5a5-7514-4aae-8ca8-fc6ae330033f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=0f6ce7f9-77b9-4eaa-be26-d3a744b62998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.objects.base [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<0f6ce7f9-77b9-4eaa-be26-d3a744b62998> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:53:10 user nova-compute[75026]:   <uuid>0f6ce7f9-77b9-4eaa-be26-d3a744b62998</uuid>
Nov 10 19:53:10 user nova-compute[75026]:   <name>instance-0000002a</name>
Nov 10 19:53:10 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:53:10 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:53:10 user nova-compute[75026]:   <metadata>
Nov 10 19:53:10 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:53:10 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:53:10 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-908037026</nova:name>
Nov 10 19:53:10 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:53:09</nova:creationTime>
Nov 10 19:53:10 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:53:10 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:53:10 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:53:10 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:53:10 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:53:10 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:53:10 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:53:10 user nova-compute[75026]:       <nova:owner>
Nov 10 19:53:10 user nova-compute[75026]:         <nova:user uuid="0dd9bbcdce294a33b2692816caee276c">tempest-AttachVolumeShelveTestJSON-2009638513-project-member</nova:user>
Nov 10 19:53:10 user nova-compute[75026]:         <nova:project uuid="8508550b77e9441e939a122e28f723e5">tempest-AttachVolumeShelveTestJSON-2009638513</nova:project>
Nov 10 19:53:10 user nova-compute[75026]:       </nova:owner>
Nov 10 19:53:10 user nova-compute[75026]:       <nova:root type="image" uuid="e76bd5a5-7514-4aae-8ca8-fc6ae330033f"/>
Nov 10 19:53:10 user nova-compute[75026]:       <nova:ports>
Nov 10 19:53:10 user nova-compute[75026]:         <nova:port uuid="b9ef9cb5-fd20-4741-a044-e0c2728e29c3">
Nov 10 19:53:10 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 19:53:10 user nova-compute[75026]:         </nova:port>
Nov 10 19:53:10 user nova-compute[75026]:       </nova:ports>
Nov 10 19:53:10 user nova-compute[75026]:     </nova:instance>
Nov 10 19:53:10 user nova-compute[75026]:   </metadata>
Nov 10 19:53:10 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:53:10 user nova-compute[75026]:     <system>
Nov 10 19:53:10 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:53:10 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:53:10 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:53:10 user nova-compute[75026]:       <entry name="serial">0f6ce7f9-77b9-4eaa-be26-d3a744b62998</entry>
Nov 10 19:53:10 user nova-compute[75026]:       <entry name="uuid">0f6ce7f9-77b9-4eaa-be26-d3a744b62998</entry>
Nov 10 19:53:10 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:53:10 user nova-compute[75026]:     </system>
Nov 10 19:53:10 user nova-compute[75026]:   </sysinfo>
Nov 10 19:53:10 user nova-compute[75026]:   <os>
Nov 10 19:53:10 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:53:10 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:53:10 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:53:10 user nova-compute[75026]:   </os>
Nov 10 19:53:10 user nova-compute[75026]:   <features>
Nov 10 19:53:10 user nova-compute[75026]:     <acpi/>
Nov 10 19:53:10 user nova-compute[75026]:     <apic/>
Nov 10 19:53:10 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:53:10 user nova-compute[75026]:   </features>
Nov 10 19:53:10 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:53:10 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:53:10 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:53:10 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:53:10 user nova-compute[75026]:   </clock>
Nov 10 19:53:10 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:53:10 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:53:10 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:53:10 user nova-compute[75026]:   </cpu>
Nov 10 19:53:10 user nova-compute[75026]:   <devices>
Nov 10 19:53:10 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:53:10 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:53:10 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk"/>
Nov 10 19:53:10 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:53:10 user nova-compute[75026]:     </disk>
Nov 10 19:53:10 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 19:53:10 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:53:10 user nova-compute[75026]:       <source dev="/dev/sdb"/>
Nov 10 19:53:10 user nova-compute[75026]:       <target dev="vdc" bus="virtio"/>
Nov 10 19:53:10 user nova-compute[75026]:       <serial>7ea7817a-fa29-45e8-bc63-0789379c46c8</serial>
Nov 10 19:53:10 user nova-compute[75026]:     </disk>
Nov 10 19:53:10 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:53:10 user nova-compute[75026]:       <mac address="fa:16:3e:14:14:98"/>
Nov 10 19:53:10 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:53:10 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:53:10 user nova-compute[75026]:       <target dev="tapb9ef9cb5-fd"/>
Nov 10 19:53:10 user nova-compute[75026]:     </interface>
Nov 10 19:53:10 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:53:10 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/console.log" append="off"/>
Nov 10 19:53:10 user nova-compute[75026]:     </serial>
Nov 10 19:53:10 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:53:10 user nova-compute[75026]:     <video>
Nov 10 19:53:10 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:53:10 user nova-compute[75026]:     </video>
Nov 10 19:53:10 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:53:10 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:53:10 user nova-compute[75026]:     </rng>
Nov 10 19:53:10 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:53:10 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:53:10 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:53:10 user nova-compute[75026]:     </memballoon>
Nov 10 19:53:10 user nova-compute[75026]:   </devices>
Nov 10 19:53:10 user nova-compute[75026]: </domain>
Nov 10 19:53:10 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-908037026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-908037026',id=42,image_ref='e76bd5a5-7514-4aae-8ca8-fc6ae330033f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-248868573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-fq6p8jz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member',shelved_at='2023-11-10T19:50:51.097210',shelved_host='user',shelved_image_id='e76bd5a5-7514-4aae-8ca8-fc6ae330033f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=0f6ce7f9-77b9-4eaa-be26-d3a744b62998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG os_vif [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdb34f7e-b465-5d61-919f-d8a4abcea30d', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9ef9cb5-fd, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9ef9cb5-fd, col_values=(('qos', UUID('7bd8c225-209a-4f52-b84c-4e145b3839ce')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9ef9cb5-fd, col_values=(('external_ids', {'iface-id': 'b9ef9cb5-fd20-4741-a044-e0c2728e29c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:14:98', 'vm-uuid': '0f6ce7f9-77b9-4eaa-be26-d3a744b62998'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:10 user nova-compute[75026]: INFO os_vif [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd')
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:53:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No VIF found with MAC fa:16:3e:14:14:98, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-6e05ed8c-8053-452a-af27-e97614b7146c req-ab4d669b-a1fb-45bb-8525-31a46a8e631a service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6e05ed8c-8053-452a-af27-e97614b7146c req-ab4d669b-a1fb-45bb-8525-31a46a8e631a service nova] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6e05ed8c-8053-452a-af27-e97614b7146c req-ab4d669b-a1fb-45bb-8525-31a46a8e631a service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6e05ed8c-8053-452a-af27-e97614b7146c req-ab4d669b-a1fb-45bb-8525-31a46a8e631a service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-6e05ed8c-8053-452a-af27-e97614b7146c req-ab4d669b-a1fb-45bb-8525-31a46a8e631a service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] No waiting events found dispatching network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:53:12 user nova-compute[75026]: WARNING nova.compute.manager [req-6e05ed8c-8053-452a-af27-e97614b7146c req-ab4d669b-a1fb-45bb-8525-31a46a8e631a service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received unexpected event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 19:53:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:53:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:53:14 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance spawned successfully.
Nov 10 19:53:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-53d9657f-3c30-4c54-b761-3c1b1d7576e0 req-51532bab-ea7f-4171-9934-76d5614042e8 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:53:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-53d9657f-3c30-4c54-b761-3c1b1d7576e0 req-51532bab-ea7f-4171-9934-76d5614042e8 service nova] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-53d9657f-3c30-4c54-b761-3c1b1d7576e0 req-51532bab-ea7f-4171-9934-76d5614042e8 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-53d9657f-3c30-4c54-b761-3c1b1d7576e0 req-51532bab-ea7f-4171-9934-76d5614042e8 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-53d9657f-3c30-4c54-b761-3c1b1d7576e0 req-51532bab-ea7f-4171-9934-76d5614042e8 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] No waiting events found dispatching network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:53:14 user nova-compute[75026]: WARNING nova.compute.manager [req-53d9657f-3c30-4c54-b761-3c1b1d7576e0 req-51532bab-ea7f-4171-9934-76d5614042e8 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received unexpected event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 19:53:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:53:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b683f2f0-5820-4ab5-b7ef-8af5e4a25ab0 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.887s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:15 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:16 user nova-compute[75026]: INFO nova.compute.manager [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attaching volume 7d2072e4-7a9d-4f97-9f8d-d969f5768fdb to /dev/vdb
Nov 10 19:53:16 user nova-compute[75026]: DEBUG os_brick.utils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15bcae3-44d4-40f5-9cf2-a45bff823d24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c352e467-a551-4d97-9b4c-cc226485309a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf615c3-9171-4692-a4b5-ef157ff4a3a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e18a9f-11d1-4966-b329-3ccf94abdc1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:53:16 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:53:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b10162-2eb4-4be9-a981-1a2718b79252]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG os_brick.utils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:53:16 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating existing volume attachment record: cd1d7911-2b15-47e2-98d7-8d433ad0e867 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:53:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:53:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:53:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:53:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:53:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updating instance_info_cache with network_info: [{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:38 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 19:53:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:53:38 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:53:38 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8524MB free_disk=25.21084976196289GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:53:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgNzGnSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:53:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:53:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:53:40 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[248821c3-8239-4045-9ae3-b5d24e733397]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:53:40 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e680f5-a5fe-475b-8044-36bb59be0a3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb] added
Nov 10 19:53:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dec2637-29e2-4822-9ef0-00ec0f7cda3f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b95b8d-fcd1-41db-8c0b-4defd6babe2a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgNzGnSx {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FgNzGnSx" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1308d4cd-d8ac-4dc3-86d6-88ec7fdc8b61]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FgNzGnSx'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2b764-c669-40fe-8a39-bf7f5f5d3df3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a409edc-8b5d-430b-b28e-40e9e52979d4]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:53:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:53:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da93fed6-374a-4547-a1a7-96e16f8f199d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb, portal: 172.16.0.220,3260]
Nov 10 19:53:40 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb, portal: 172.16.0.220,3260] successful.
Nov 10 19:53:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b1f4f4-0fcf-4e50-8151-f963616aacac]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:53:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6887421c-b8dc-408f-8a44-e2c5e2d7076d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:53:41 user nova-compute[75026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb (non-flash)
Nov 10 19:53:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:53:41 user nova-compute[75026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb (non-flash)
Nov 10 19:53:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.054s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6356e416-e9a2-4af3-be37-42c7c303a9cb]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:53:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgNzGnSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23834333463376163', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834333463376163', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:53:42 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:53:42 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:53:42 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:53:42 user nova-compute[75026]:   <serial>7d2072e4-7a9d-4f97-9f8d-d969f5768fdb</serial>
Nov 10 19:53:42 user nova-compute[75026]: </disk>
Nov 10 19:53:42 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No VIF found with MAC fa:16:3e:4f:c9:a3, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fe99e97-74f6-4c19-84dd-6472b9571f59 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.546s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.271s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:53:43 user nova-compute[75026]: INFO nova.compute.claims [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Claim successful on node user
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:53:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.policy [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd6c5920b28543ab859267ec7278b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7586dc2316c4a26b8a23491f430d07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:53:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Creating image(s)
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "/opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "/opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk 1073741824" returned: 0 in 0.052s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Successfully created port: 6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Cannot resize image /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Ensure instance console log exists: /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Successfully updated port: 6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquired lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-56c1b767-8876-4bfb-a2c8-04df13ce5795 req-603641aa-b1b6-4435-8d3c-344037f41c90 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-changed-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG nova.compute.manager [req-56c1b767-8876-4bfb-a2c8-04df13ce5795 req-603641aa-b1b6-4435-8d3c-344037f41c90 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Refreshing instance network info cache due to event network-changed-6d624b2a-7779-45da-bc34-617b60e9acd5. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:53:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-56c1b767-8876-4bfb-a2c8-04df13ce5795 req-603641aa-b1b6-4435-8d3c-344037f41c90 service nova] Acquiring lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updating instance_info_cache with network_info: [{"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Releasing lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Instance network_info: |[{"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-56c1b767-8876-4bfb-a2c8-04df13ce5795 req-603641aa-b1b6-4435-8d3c-344037f41c90 service nova] Acquired lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.neutron [req-56c1b767-8876-4bfb-a2c8-04df13ce5795 req-603641aa-b1b6-4435-8d3c-344037f41c90 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Refreshing network info cache for port 6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Start _get_guest_xml network_info=[{"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:53:45 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:53:45 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-757559947',display_name='tempest-TestStampPattern-server-757559947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-757559947',id=46,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgQJf+K5q9482jlgZcnbGU3mPdTxCa9QVlp+GK538Zi4nk447tX7z9aDvYXqC82MKGVm4iUZjP/MyQSczaZobWktrkPQfNgE3pr8E4SSuPbR+IHKrONBgSCKyqrJOCD3w==',key_name='tempest-TestStampPattern-3594168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7586dc2316c4a26b8a23491f430d07e',ramdisk_id='',reservation_id='r-njjy0wzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-60453673',owner_user_name='tempest-TestStampPattern-60453673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:53:44Z,user_data=None,user_id='bd6c5920b28543ab859267ec7278b317',uuid=5b89c7bd-bb17-4b9d-a4b2-02cc5af21666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converting VIF {"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:42:5c,bridge_name='br-int',has_traffic_filtering=True,id=6d624b2a-7779-45da-bc34-617b60e9acd5,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d624b2a-77') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:53:45 user nova-compute[75026]:   <uuid>5b89c7bd-bb17-4b9d-a4b2-02cc5af21666</uuid>
Nov 10 19:53:45 user nova-compute[75026]:   <name>instance-0000002e</name>
Nov 10 19:53:45 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:53:45 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:53:45 user nova-compute[75026]:   <metadata>
Nov 10 19:53:45 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:53:45 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:53:45 user nova-compute[75026]:       <nova:name>tempest-TestStampPattern-server-757559947</nova:name>
Nov 10 19:53:45 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:53:45</nova:creationTime>
Nov 10 19:53:45 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:53:45 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:53:45 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:53:45 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:53:45 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:53:45 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:53:45 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:53:45 user nova-compute[75026]:       <nova:owner>
Nov 10 19:53:45 user nova-compute[75026]:         <nova:user uuid="bd6c5920b28543ab859267ec7278b317">tempest-TestStampPattern-60453673-project-member</nova:user>
Nov 10 19:53:45 user nova-compute[75026]:         <nova:project uuid="d7586dc2316c4a26b8a23491f430d07e">tempest-TestStampPattern-60453673</nova:project>
Nov 10 19:53:45 user nova-compute[75026]:       </nova:owner>
Nov 10 19:53:45 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:53:45 user nova-compute[75026]:       <nova:ports>
Nov 10 19:53:45 user nova-compute[75026]:         <nova:port uuid="6d624b2a-7779-45da-bc34-617b60e9acd5">
Nov 10 19:53:45 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 19:53:45 user nova-compute[75026]:         </nova:port>
Nov 10 19:53:45 user nova-compute[75026]:       </nova:ports>
Nov 10 19:53:45 user nova-compute[75026]:     </nova:instance>
Nov 10 19:53:45 user nova-compute[75026]:   </metadata>
Nov 10 19:53:45 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:53:45 user nova-compute[75026]:     <system>
Nov 10 19:53:45 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:53:45 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:53:45 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:53:45 user nova-compute[75026]:       <entry name="serial">5b89c7bd-bb17-4b9d-a4b2-02cc5af21666</entry>
Nov 10 19:53:45 user nova-compute[75026]:       <entry name="uuid">5b89c7bd-bb17-4b9d-a4b2-02cc5af21666</entry>
Nov 10 19:53:45 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:53:45 user nova-compute[75026]:     </system>
Nov 10 19:53:45 user nova-compute[75026]:   </sysinfo>
Nov 10 19:53:45 user nova-compute[75026]:   <os>
Nov 10 19:53:45 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:53:45 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:53:45 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:53:45 user nova-compute[75026]:   </os>
Nov 10 19:53:45 user nova-compute[75026]:   <features>
Nov 10 19:53:45 user nova-compute[75026]:     <acpi/>
Nov 10 19:53:45 user nova-compute[75026]:     <apic/>
Nov 10 19:53:45 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:53:45 user nova-compute[75026]:   </features>
Nov 10 19:53:45 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:53:45 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:53:45 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:53:45 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:53:45 user nova-compute[75026]:   </clock>
Nov 10 19:53:45 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:53:45 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:53:45 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:53:45 user nova-compute[75026]:   </cpu>
Nov 10 19:53:45 user nova-compute[75026]:   <devices>
Nov 10 19:53:45 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:53:45 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:53:45 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk"/>
Nov 10 19:53:45 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:53:45 user nova-compute[75026]:     </disk>
Nov 10 19:53:45 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:53:45 user nova-compute[75026]:       <mac address="fa:16:3e:dc:42:5c"/>
Nov 10 19:53:45 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:53:45 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:53:45 user nova-compute[75026]:       <target dev="tap6d624b2a-77"/>
Nov 10 19:53:45 user nova-compute[75026]:     </interface>
Nov 10 19:53:45 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:53:45 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/console.log" append="off"/>
Nov 10 19:53:45 user nova-compute[75026]:     </serial>
Nov 10 19:53:45 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:53:45 user nova-compute[75026]:     <video>
Nov 10 19:53:45 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:53:45 user nova-compute[75026]:     </video>
Nov 10 19:53:45 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:53:45 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:53:45 user nova-compute[75026]:     </rng>
Nov 10 19:53:45 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:53:45 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:53:45 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:53:45 user nova-compute[75026]:     </memballoon>
Nov 10 19:53:45 user nova-compute[75026]:   </devices>
Nov 10 19:53:45 user nova-compute[75026]: </domain>
Nov 10 19:53:45 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-757559947',display_name='tempest-TestStampPattern-server-757559947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-757559947',id=46,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgQJf+K5q9482jlgZcnbGU3mPdTxCa9QVlp+GK538Zi4nk447tX7z9aDvYXqC82MKGVm4iUZjP/MyQSczaZobWktrkPQfNgE3pr8E4SSuPbR+IHKrONBgSCKyqrJOCD3w==',key_name='tempest-TestStampPattern-3594168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7586dc2316c4a26b8a23491f430d07e',ramdisk_id='',reservation_id='r-njjy0wzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-60453673',owner_user_name='tempest-TestStampPattern-60453673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:53:44Z,user_data=None,user_id='bd6c5920b28543ab859267ec7278b317',uuid=5b89c7bd-bb17-4b9d-a4b2-02cc5af21666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converting VIF {"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:42:5c,bridge_name='br-int',has_traffic_filtering=True,id=6d624b2a-7779-45da-bc34-617b60e9acd5,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d624b2a-77') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG os_vif [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:42:5c,bridge_name='br-int',has_traffic_filtering=True,id=6d624b2a-7779-45da-bc34-617b60e9acd5,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d624b2a-77') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36acb0ed-65e5-5fc4-be97-73f7597de419', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d624b2a-77, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d624b2a-77, col_values=(('qos', UUID('4f1d1db9-c492-4d07-96d6-3aa69b56ac41')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d624b2a-77, col_values=(('external_ids', {'iface-id': '6d624b2a-7779-45da-bc34-617b60e9acd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:42:5c', 'vm-uuid': '5b89c7bd-bb17-4b9d-a4b2-02cc5af21666'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:45 user nova-compute[75026]: INFO os_vif [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:42:5c,bridge_name='br-int',has_traffic_filtering=True,id=6d624b2a-7779-45da-bc34-617b60e9acd5,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d624b2a-77')
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No VIF found with MAC fa:16:3e:dc:42:5c, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.neutron [req-56c1b767-8876-4bfb-a2c8-04df13ce5795 req-603641aa-b1b6-4435-8d3c-344037f41c90 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updated VIF entry in instance network info cache for port 6d624b2a-7779-45da-bc34-617b60e9acd5. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG nova.network.neutron [req-56c1b767-8876-4bfb-a2c8-04df13ce5795 req-603641aa-b1b6-4435-8d3c-344037f41c90 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updating instance_info_cache with network_info: [{"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:53:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-56c1b767-8876-4bfb-a2c8-04df13ce5795 req-603641aa-b1b6-4435-8d3c-344037f41c90 service nova] Releasing lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:53:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-28f950bd-75c8-4bcb-83be-2c1af268f374 req-77586491-ed7f-44de-82ef-a62296414589 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:53:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28f950bd-75c8-4bcb-83be-2c1af268f374 req-77586491-ed7f-44de-82ef-a62296414589 service nova] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28f950bd-75c8-4bcb-83be-2c1af268f374 req-77586491-ed7f-44de-82ef-a62296414589 service nova] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-28f950bd-75c8-4bcb-83be-2c1af268f374 req-77586491-ed7f-44de-82ef-a62296414589 service nova] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-28f950bd-75c8-4bcb-83be-2c1af268f374 req-77586491-ed7f-44de-82ef-a62296414589 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] No waiting events found dispatching network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:53:47 user nova-compute[75026]: WARNING nova.compute.manager [req-28f950bd-75c8-4bcb-83be-2c1af268f374 req-77586491-ed7f-44de-82ef-a62296414589 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received unexpected event network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 for instance with vm_state building and task_state spawning.
Nov 10 19:53:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:53:49 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Instance spawned successfully.
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-0d71d465-2f6c-401c-8df0-fff0e439a5c0 req-bbd84838-3d22-473a-9b34-29282319ffa8 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0d71d465-2f6c-401c-8df0-fff0e439a5c0 req-bbd84838-3d22-473a-9b34-29282319ffa8 service nova] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0d71d465-2f6c-401c-8df0-fff0e439a5c0 req-bbd84838-3d22-473a-9b34-29282319ffa8 service nova] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0d71d465-2f6c-401c-8df0-fff0e439a5c0 req-bbd84838-3d22-473a-9b34-29282319ffa8 service nova] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-0d71d465-2f6c-401c-8df0-fff0e439a5c0 req-bbd84838-3d22-473a-9b34-29282319ffa8 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] No waiting events found dispatching network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:53:49 user nova-compute[75026]: WARNING nova.compute.manager [req-0d71d465-2f6c-401c-8df0-fff0e439a5c0 req-bbd84838-3d22-473a-9b34-29282319ffa8 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received unexpected event network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 for instance with vm_state building and task_state spawning.
Nov 10 19:53:49 user nova-compute[75026]: INFO nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 10 19:53:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:53:49 user nova-compute[75026]: INFO nova.compute.manager [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Took 6.20 seconds to build instance.
Nov 10 19:53:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4c13725f-625e-453a-82c5-b125bee64122 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.296s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:53:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:53:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:23 user nova-compute[75026]: INFO nova.compute.manager [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Detaching volume 7d2072e4-7a9d-4f97-9f8d-d969f5768fdb
Nov 10 19:54:23 user nova-compute[75026]: INFO nova.virt.block_device [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attempting to driver detach volume 7d2072e4-7a9d-4f97-9f8d-d969f5768fdb from mountpoint /dev/vdb
Nov 10 19:54:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Attempting to detach device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:54:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:54:23 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:54:23 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:54:23 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:54:23 user nova-compute[75026]:   <serial>7d2072e4-7a9d-4f97-9f8d-d969f5768fdb</serial>
Nov 10 19:54:23 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:54:23 user nova-compute[75026]: </disk>
Nov 10 19:54:23 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:54:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully detached device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the persistent domain config.
Nov 10 19:54:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d852683-d701-472f-a089-ce5742ba3802 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:54:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:54:23 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:54:23 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:54:23 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:54:23 user nova-compute[75026]:   <serial>7d2072e4-7a9d-4f97-9f8d-d969f5768fdb</serial>
Nov 10 19:54:23 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:54:23 user nova-compute[75026]: </disk>
Nov 10 19:54:23 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:54:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:54:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:54:27 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:28 user nova-compute[75026]: INFO nova.compute.manager [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Detaching volume 7ea7817a-fa29-45e8-bc63-0789379c46c8
Nov 10 19:54:28 user nova-compute[75026]: INFO nova.virt.block_device [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Attempting to driver detach volume 7ea7817a-fa29-45e8-bc63-0789379c46c8 from mountpoint /dev/vdc
Nov 10 19:54:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Attempting to detach device vdc from instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:54:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:54:29 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:54:29 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:54:29 user nova-compute[75026]:   <target dev="vdc" bus="virtio"/>
Nov 10 19:54:29 user nova-compute[75026]:   <serial>7ea7817a-fa29-45e8-bc63-0789379c46c8</serial>
Nov 10 19:54:29 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 19:54:29 user nova-compute[75026]: </disk>
Nov 10 19:54:29 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:54:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully detached device vdc from instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 from the persistent domain config.
Nov 10 19:54:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:54:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:54:29 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:54:29 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:54:29 user nova-compute[75026]:   <target dev="vdc" bus="virtio"/>
Nov 10 19:54:29 user nova-compute[75026]:   <serial>7ea7817a-fa29-45e8-bc63-0789379c46c8</serial>
Nov 10 19:54:29 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 19:54:29 user nova-compute[75026]: </disk>
Nov 10 19:54:29 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:54:29 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:54:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:34 user nova-compute[75026]: INFO nova.compute.manager [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Rescuing
Nov 10 19:54:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:54:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:54:34 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:54:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-0b86300f-2105-4022-84d7-a8fcc84f7063 req-de3be75f-1a06-43e7-8c77-a83bb608b2c6 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0b86300f-2105-4022-84d7-a8fcc84f7063 req-de3be75f-1a06-43e7-8c77-a83bb608b2c6 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0b86300f-2105-4022-84d7-a8fcc84f7063 req-de3be75f-1a06-43e7-8c77-a83bb608b2c6 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0b86300f-2105-4022-84d7-a8fcc84f7063 req-de3be75f-1a06-43e7-8c77-a83bb608b2c6 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-0b86300f-2105-4022-84d7-a8fcc84f7063 req-de3be75f-1a06-43e7-8c77-a83bb608b2c6 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:54:35 user nova-compute[75026]: WARNING nova.compute.manager [req-0b86300f-2105-4022-84d7-a8fcc84f7063 req-de3be75f-1a06-43e7-8c77-a83bb608b2c6 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state active and task_state rescuing.
Nov 10 19:54:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance destroyed successfully.
Nov 10 19:54:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Attempting rescue
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance directory exists: not creating {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 19:54:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Creating image(s)
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'trusted_certs' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue" returned: 0 in 0.054s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'migration_context' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.objects.base [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<39176d38-43bf-49b4-8f64-cd16b5ada8a7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Start _get_guest_xml network_info=[{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:2e:ae:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'resources' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.objects.base [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<39176d38-43bf-49b4-8f64-cd16b5ada8a7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'numa_topology' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.objects.base [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<39176d38-43bf-49b4-8f64-cd16b5ada8a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:54:35 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:54:35 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:54:35 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.objects.base [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<39176d38-43bf-49b4-8f64-cd16b5ada8a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-864115750',display_name='tempest-ServerRescueNegativeTestJSON-server-864115750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-864115750',id=43,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-9ybrbs1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:49:55Z,user_data=None,user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=39176d38-43bf-49b4-8f64-cd16b5ada8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:2e:ae:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:2e:ae:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ae:d8,bridge_name='br-int',has_traffic_filtering=True,id=21c048fe-3b5b-4287-bf6e-f5df5a6812fa,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c048fe-3b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'pci_devices' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.objects.base [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<39176d38-43bf-49b4-8f64-cd16b5ada8a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:54:36 user nova-compute[75026]:   <uuid>39176d38-43bf-49b4-8f64-cd16b5ada8a7</uuid>
Nov 10 19:54:36 user nova-compute[75026]:   <name>instance-0000002b</name>
Nov 10 19:54:36 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:54:36 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:54:36 user nova-compute[75026]:   <metadata>
Nov 10 19:54:36 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:54:36 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:54:36 user nova-compute[75026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-864115750</nova:name>
Nov 10 19:54:36 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:54:35</nova:creationTime>
Nov 10 19:54:36 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:54:36 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:54:36 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:54:36 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:54:36 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:54:36 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:54:36 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:54:36 user nova-compute[75026]:       <nova:owner>
Nov 10 19:54:36 user nova-compute[75026]:         <nova:user uuid="b7ef73abaece4f08b00d81d403a8a66a">tempest-ServerRescueNegativeTestJSON-1130240525-project-member</nova:user>
Nov 10 19:54:36 user nova-compute[75026]:         <nova:project uuid="64d8f446a3094348839f9216faff0485">tempest-ServerRescueNegativeTestJSON-1130240525</nova:project>
Nov 10 19:54:36 user nova-compute[75026]:       </nova:owner>
Nov 10 19:54:36 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:54:36 user nova-compute[75026]:       <nova:ports>
Nov 10 19:54:36 user nova-compute[75026]:         <nova:port uuid="21c048fe-3b5b-4287-bf6e-f5df5a6812fa">
Nov 10 19:54:36 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 19:54:36 user nova-compute[75026]:         </nova:port>
Nov 10 19:54:36 user nova-compute[75026]:       </nova:ports>
Nov 10 19:54:36 user nova-compute[75026]:     </nova:instance>
Nov 10 19:54:36 user nova-compute[75026]:   </metadata>
Nov 10 19:54:36 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:54:36 user nova-compute[75026]:     <system>
Nov 10 19:54:36 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:54:36 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:54:36 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:54:36 user nova-compute[75026]:       <entry name="serial">39176d38-43bf-49b4-8f64-cd16b5ada8a7</entry>
Nov 10 19:54:36 user nova-compute[75026]:       <entry name="uuid">39176d38-43bf-49b4-8f64-cd16b5ada8a7</entry>
Nov 10 19:54:36 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:54:36 user nova-compute[75026]:     </system>
Nov 10 19:54:36 user nova-compute[75026]:   </sysinfo>
Nov 10 19:54:36 user nova-compute[75026]:   <os>
Nov 10 19:54:36 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:54:36 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:54:36 user nova-compute[75026]:   </os>
Nov 10 19:54:36 user nova-compute[75026]:   <features>
Nov 10 19:54:36 user nova-compute[75026]:     <acpi/>
Nov 10 19:54:36 user nova-compute[75026]:     <apic/>
Nov 10 19:54:36 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:54:36 user nova-compute[75026]:   </features>
Nov 10 19:54:36 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:54:36 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:54:36 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:54:36 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:54:36 user nova-compute[75026]:   </clock>
Nov 10 19:54:36 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:54:36 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:54:36 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:54:36 user nova-compute[75026]:   </cpu>
Nov 10 19:54:36 user nova-compute[75026]:   <devices>
Nov 10 19:54:36 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:54:36 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:54:36 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue"/>
Nov 10 19:54:36 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:54:36 user nova-compute[75026]:     </disk>
Nov 10 19:54:36 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:54:36 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:54:36 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk"/>
Nov 10 19:54:36 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 19:54:36 user nova-compute[75026]:     </disk>
Nov 10 19:54:36 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:54:36 user nova-compute[75026]:       <mac address="fa:16:3e:2e:ae:d8"/>
Nov 10 19:54:36 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:54:36 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:54:36 user nova-compute[75026]:       <target dev="tap21c048fe-3b"/>
Nov 10 19:54:36 user nova-compute[75026]:     </interface>
Nov 10 19:54:36 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:54:36 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/console.log" append="off"/>
Nov 10 19:54:36 user nova-compute[75026]:     </serial>
Nov 10 19:54:36 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:54:36 user nova-compute[75026]:     <video>
Nov 10 19:54:36 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:54:36 user nova-compute[75026]:     </video>
Nov 10 19:54:36 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:54:36 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:54:36 user nova-compute[75026]:     </rng>
Nov 10 19:54:36 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:54:36 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:54:36 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:54:36 user nova-compute[75026]:     </memballoon>
Nov 10 19:54:36 user nova-compute[75026]:   </devices>
Nov 10 19:54:36 user nova-compute[75026]: </domain>
Nov 10 19:54:36 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:54:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance destroyed successfully.
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No VIF found with MAC fa:16:3e:2e:ae:d8, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:36 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-61419507-592b-49a5-8950-193119285c63 req-85f931f6-46ae-427b-be33-d07caa184b8f service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-61419507-592b-49a5-8950-193119285c63 req-85f931f6-46ae-427b-be33-d07caa184b8f service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-61419507-592b-49a5-8950-193119285c63 req-85f931f6-46ae-427b-be33-d07caa184b8f service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-61419507-592b-49a5-8950-193119285c63 req-85f931f6-46ae-427b-be33-d07caa184b8f service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG nova.compute.manager [req-61419507-592b-49a5-8950-193119285c63 req-85f931f6-46ae-427b-be33-d07caa184b8f service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:54:37 user nova-compute[75026]: WARNING nova.compute.manager [req-61419507-592b-49a5-8950-193119285c63 req-85f931f6-46ae-427b-be33-d07caa184b8f service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state active and task_state rescuing.
Nov 10 19:54:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:54:39 user nova-compute[75026]: WARNING nova.compute.manager [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state active and task_state rescuing.
Nov 10 19:54:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG nova.compute.manager [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:54:39 user nova-compute[75026]: WARNING nova.compute.manager [req-9f2f4e9e-2291-4b70-b010-6ee928ff4a99 req-9cc803b0-1e7a-4c06-8fdf-ca0ba69adb45 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state active and task_state rescuing.
Nov 10 19:54:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f2c602e9-e4d6-4259-b9d4-316290bdd536 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:40 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:54:40 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:54:40 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=25.17975616455078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:54:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:54:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:54:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating instance_info_cache with network_info: [{"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:54:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:43 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d852683-d701-472f-a089-ce5742ba3802 is timed out.
Nov 10 19:54:43 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully detached device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the live domain config.
Nov 10 19:54:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FgNzGnSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:54:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2603a48-f3c3-4cad-ad88-61e11b19959a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:54:43 user nova-compute[75026]: No targets found.
Nov 10 19:54:43 user nova-compute[75026]: iSNS:
Nov 10 19:54:43 user nova-compute[75026]: No targets found.
Nov 10 19:54:43 user nova-compute[75026]: STATIC:
Nov 10 19:54:43 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8
Nov 10 19:54:43 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:54:43 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:54:43 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb
Nov 10 19:54:43 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:54:43 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:54:43 user nova-compute[75026]: FIRMWARE:
Nov 10 19:54:43 user nova-compute[75026]: No targets found.
Nov 10 19:54:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:54:43 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:54:43 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[79651756-2099-4856-a200-c516c850d153]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bfce4f-6cbe-462a-9d0e-3a312c01695e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:54:43 user nova-compute[75026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb (non-flash)
Nov 10 19:54:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:54:43 user nova-compute[75026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb (non-flash)
Nov 10 19:54:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0399d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[906fec34-1f26-4a36-b923-cf25a6934a52]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6764ed28-a76b-4600-80d0-b32490051445]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c7d277-6545-429b-aec5-d608996ed576]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc1cd0f-ebf6-4a57-ab39-24693c0e98ec]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5958ce-ee3c-4ce5-96a7-61d074535cfa]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7c9840-5bc7-40a8-90c4-fb327dd13af7]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb, portal: 172.16.0.220,3260]
Nov 10 19:54:43 user nova-compute[75026]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb, portal: 172.16.0.220,3260] successful.
Nov 10 19:54:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2072e4-7a9d-4f97-9f8d-d969f5768fdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a738a-d313-4443-8005-ef9a3f5fb847]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== disconnect_volume: return (293ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:54:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:54:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:54:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-88e5b32d-5f94-49be-b8b6-5fdc0b9a4288 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:54:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 is timed out.
Nov 10 19:54:49 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully detached device vdc from instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 from the live domain config.
Nov 10 19:54:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfkEosWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:54:49 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fdf2ac-37ac-41fb-9c0f-f0cb4fd29c11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:54:49 user nova-compute[75026]: No targets found.
Nov 10 19:54:49 user nova-compute[75026]: iSNS:
Nov 10 19:54:49 user nova-compute[75026]: No targets found.
Nov 10 19:54:49 user nova-compute[75026]: STATIC:
Nov 10 19:54:49 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8
Nov 10 19:54:49 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:54:49 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:54:49 user nova-compute[75026]: FIRMWARE:
Nov 10 19:54:49 user nova-compute[75026]: No targets found.
Nov 10 19:54:49 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:54:49 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:54:49 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a565531b-6c97-4233-9f37-1a8b333bd4bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10d231b-aaa4-46dd-9cc6-1c8bc1572967]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:54:49 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 (non-flash)
Nov 10 19:54:49 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda0259630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d063fe8-42f5-4ac5-9640-049f8a789cf4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7b153a-9f12-40d5-9293-f3128829e72e]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9afac5-4291-4ea0-b946-6d51fb58d314]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c871939-680e-4723-8e97-480d34550c16]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd887e09-3be9-4030-afd2-219f32ca7b6b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e14fbf0-dd3c-412e-8fd2-63c75faf6044]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8, portal: 172.16.0.220,3260]
Nov 10 19:54:49 user nova-compute[75026]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8, portal: 172.16.0.220,3260] successful.
Nov 10 19:54:49 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7817a-fa29-45e8-bc63-0789379c46c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2121cc-3b2a-4ea1-ab15-e420cb46665f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] <== disconnect_volume: return (283ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:54:49 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:54:50 user nova-compute[75026]: DEBUG nova.objects.instance [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'flavor' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:54:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e32473f4-939f-46af-a923-1477bb72edc3 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.943s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:54:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:54:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:19 user nova-compute[75026]: INFO nova.compute.manager [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Terminating instance
Nov 10 19:55:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG nova.objects.instance [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-956a9ce6-c13c-41f6-aceb-313909970216 req-7874497b-d17e-4b4c-8039-d8acd74f40f7 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-unplugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-956a9ce6-c13c-41f6-aceb-313909970216 req-7874497b-d17e-4b4c-8039-d8acd74f40f7 service nova] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-956a9ce6-c13c-41f6-aceb-313909970216 req-7874497b-d17e-4b4c-8039-d8acd74f40f7 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-956a9ce6-c13c-41f6-aceb-313909970216 req-7874497b-d17e-4b4c-8039-d8acd74f40f7 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-956a9ce6-c13c-41f6-aceb-313909970216 req-7874497b-d17e-4b4c-8039-d8acd74f40f7 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] No waiting events found dispatching network-vif-unplugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-956a9ce6-c13c-41f6-aceb-313909970216 req-7874497b-d17e-4b4c-8039-d8acd74f40f7 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-unplugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:19 user nova-compute[75026]: INFO nova.compute.manager [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attaching volume e9edf160-7bf9-4343-9dd0-0158fca556ea to /dev/vdb
Nov 10 19:55:19 user nova-compute[75026]: DEBUG os_brick.utils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5df9af-1927-4fd6-bf6f-6b76d472ee78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbc14f6-b4ea-41b9-b932-bdee97f44764]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[594bac07-d823-44cd-a329-0d0d9c8815ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd31ec8-4eba-4953-9648-048cd3f2ee1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:55:19 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:55:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e984979f-1a2e-474d-b88c-7a0e81bf3415]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG os_brick.utils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:55:19 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating existing volume attachment record: 7959bd8a-7243-4553-a5ae-32ad95023825 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:55:20 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Instance destroyed successfully.
Nov 10 19:55:20 user nova-compute[75026]: DEBUG nova.objects.instance [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'resources' on Instance uuid 0f6ce7f9-77b9-4eaa-be26-d3a744b62998 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-908037026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-908037026',id=42,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIE1AtIt3kfTXM1U33jFPmfw8t4446A5GGx+ewqUknZgYlW/S9kG4yNVkxxN9+I6B0yYJVurvEn2AFRqt5Iqlwou9A9x/pA+qnM4fSat4ZcgHTQTxFELYbnUDGZ2W6rUA==',key_name='tempest-keypair-248868573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-fq6p8jz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:53:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=0f6ce7f9-77b9-4eaa-be26-d3a744b62998,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "address": "fa:16:3e:14:14:98", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9ef9cb5-fd", "ovs_interfaceid": "b9ef9cb5-fd20-4741-a044-e0c2728e29c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG os_vif [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9ef9cb5-fd, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bd8c225-209a-4f52-b84c-4e145b3839ce) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:55:20 user nova-compute[75026]: INFO os_vif [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:14:98,bridge_name='br-int',has_traffic_filtering=True,id=b9ef9cb5-fd20-4741-a044-e0c2728e29c3,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9ef9cb5-fd')
Nov 10 19:55:20 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Deleting instance files /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998_del
Nov 10 19:55:20 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Deletion of /opt/stack/data/nova/instances/0f6ce7f9-77b9-4eaa-be26-d3a744b62998_del complete
Nov 10 19:55:20 user nova-compute[75026]: INFO nova.compute.manager [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 19:55:20 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:55:20 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Took 0.75 seconds to deallocate network for instance.
Nov 10 19:55:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-d4ed1781-3a65-4d35-b61b-a7346919fe31 req-3d1a9eeb-fc54-4843-80ab-de01f9a18401 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-deleted-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:55:21 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:55:21 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:55:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:21 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Deleted allocations for instance 0f6ce7f9-77b9-4eaa-be26-d3a744b62998
Nov 10 19:55:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-50c58120-1b79-40a7-8d02-5096d544b09c tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-8e06f4b7-e0ff-46e3-8db7-3e7fb82fa30a req-44840577-7f04-460c-b325-21524f69cdd9 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:55:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8e06f4b7-e0ff-46e3-8db7-3e7fb82fa30a req-44840577-7f04-460c-b325-21524f69cdd9 service nova] Acquiring lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8e06f4b7-e0ff-46e3-8db7-3e7fb82fa30a req-44840577-7f04-460c-b325-21524f69cdd9 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8e06f4b7-e0ff-46e3-8db7-3e7fb82fa30a req-44840577-7f04-460c-b325-21524f69cdd9 service nova] Lock "0f6ce7f9-77b9-4eaa-be26-d3a744b62998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-8e06f4b7-e0ff-46e3-8db7-3e7fb82fa30a req-44840577-7f04-460c-b325-21524f69cdd9 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] No waiting events found dispatching network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:55:21 user nova-compute[75026]: WARNING nova.compute.manager [req-8e06f4b7-e0ff-46e3-8db7-3e7fb82fa30a req-44840577-7f04-460c-b325-21524f69cdd9 service nova] [instance: 0f6ce7f9-77b9-4eaa-be26-d3a744b62998] Received unexpected event network-vif-plugged-b9ef9cb5-fd20-4741-a044-e0c2728e29c3 for instance with vm_state deleted and task_state None.
Nov 10 19:55:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:29 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-04505b82-a268-444b-880d-e7dd214c7487 req-a507c909-01ac-4aaf-aa0e-def720ddd7a7 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-changed-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:55:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-04505b82-a268-444b-880d-e7dd214c7487 req-a507c909-01ac-4aaf-aa0e-def720ddd7a7 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Refreshing instance network info cache due to event network-changed-6d624b2a-7779-45da-bc34-617b60e9acd5. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:55:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04505b82-a268-444b-880d-e7dd214c7487 req-a507c909-01ac-4aaf-aa0e-def720ddd7a7 service nova] Acquiring lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:55:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04505b82-a268-444b-880d-e7dd214c7487 req-a507c909-01ac-4aaf-aa0e-def720ddd7a7 service nova] Acquired lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:55:34 user nova-compute[75026]: DEBUG nova.network.neutron [req-04505b82-a268-444b-880d-e7dd214c7487 req-a507c909-01ac-4aaf-aa0e-def720ddd7a7 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Refreshing network info cache for port 6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:55:35 user nova-compute[75026]: DEBUG nova.network.neutron [req-04505b82-a268-444b-880d-e7dd214c7487 req-a507c909-01ac-4aaf-aa0e-def720ddd7a7 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updated VIF entry in instance network info cache for port 6d624b2a-7779-45da-bc34-617b60e9acd5. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:55:35 user nova-compute[75026]: DEBUG nova.network.neutron [req-04505b82-a268-444b-880d-e7dd214c7487 req-a507c909-01ac-4aaf-aa0e-def720ddd7a7 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updating instance_info_cache with network_info: [{"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:55:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-04505b82-a268-444b-880d-e7dd214c7487 req-a507c909-01ac-4aaf-aa0e-def720ddd7a7 service nova] Releasing lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:55:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG nova.objects.instance [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'flavor' on Instance uuid 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:36 user nova-compute[75026]: INFO nova.compute.manager [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Attaching volume 03de6683-0517-413e-8c9e-21841a6b9c49 to /dev/vdb
Nov 10 19:55:36 user nova-compute[75026]: DEBUG os_brick.utils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6795d9ef-d27e-4a16-adcb-cc6d61c542bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63ff87d-42bb-4d5c-b471-8e75c034d47f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b377de0-f841-40e3-a2a6-d1a635fe0564]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1fbc68-9e6f-42c5-a241-b3b1048e51fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:55:36 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d3060-e613-4850-a3e1-6fd023325e8f]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG os_brick.utils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updating existing volume attachment record: b5123b2e-556c-49cf-86f6-12cdcd31eaf7 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:55:36 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:37 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:39 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:55:39 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.20583724975586GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:55:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:55:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:55:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:55:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:55:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:55:40 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:55:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:55:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:55:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:55:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyBkMxdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:55:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:55:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:55:43 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[169224a5-28ae-4aca-8f62-34426cff35be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:55:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b569059-d7bd-4fae-9e05-1f6584808d1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea] added
Nov 10 19:55:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8180e161-aacf-43ac-97f9-b3265b00de43]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f771aa-3f73-4c37-895e-f3dd67734611]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wyBkMxdX {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wyBkMxdX" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1dd4e-af0f-4e1c-a192-4f32e3bdd341]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wyBkMxdX'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f921faa-0258-414a-811d-d6ab31b61e49]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d624ca58-7cab-4aac-9b3f-764a858109ae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:55:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:55:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:55:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:55:43 user nova-compute[75026]: 
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0474e2-4465-4e9a-9646-7f3bbcd0358f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea, portal: 172.16.0.220,3260]
Nov 10 19:55:43 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea, portal: 172.16.0.220,3260] successful.
Nov 10 19:55:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.059s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6516fac5-f27c-4242-b754-9075999bf197]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84debcf1-e687-4055-8633-766fef8c6a2a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)
Nov 10 19:55:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)
Nov 10 19:55:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e6ef7-c9f1-44f0-a164-6019cd07b969]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:55:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyBkMxdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26335326434366333', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335326434366333', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:55:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:55:44 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:55:44 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:55:44 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:55:44 user nova-compute[75026]:   <serial>e9edf160-7bf9-4343-9dd0-0158fca556ea</serial>
Nov 10 19:55:44 user nova-compute[75026]: </disk>
Nov 10 19:55:44 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:55:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:55:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:55:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No VIF found with MAC fa:16:3e:4f:c9:a3, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:55:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-aa08c615-20c3-4563-9672-14c75cffd41d tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.841s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:55:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:55:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:55:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:55:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:55:47 user nova-compute[75026]: INFO nova.compute.manager [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Detaching volume e9edf160-7bf9-4343-9dd0-0158fca556ea
Nov 10 19:55:47 user nova-compute[75026]: INFO nova.virt.block_device [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attempting to driver detach volume e9edf160-7bf9-4343-9dd0-0158fca556ea from mountpoint /dev/vdb
Nov 10 19:55:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Attempting to detach device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:55:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:55:47 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:55:47 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:55:47 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:55:47 user nova-compute[75026]:   <serial>e9edf160-7bf9-4343-9dd0-0158fca556ea</serial>
Nov 10 19:55:47 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:55:47 user nova-compute[75026]: </disk>
Nov 10 19:55:47 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:55:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully detached device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the persistent domain config.
Nov 10 19:55:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d852683-d701-472f-a089-ce5742ba3802 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:55:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:55:47 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:55:47 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:55:47 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:55:47 user nova-compute[75026]:   <serial>e9edf160-7bf9-4343-9dd0-0158fca556ea</serial>
Nov 10 19:55:47 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:55:47 user nova-compute[75026]: </disk>
Nov 10 19:55:47 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:55:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:55:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:55:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckgBnouH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:56:00 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:56:00 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:56:00 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f084559c-f183-4405-970c-7bbfde66d357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:56:00 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[067e74a3-6edf-4fa5-b716-0652a1196462]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49] added
Nov 10 19:56:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[946352ec-3a71-4e98-8b9c-0bf0b2477781]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a65637-d596-466b-9610-0ee0ee2705eb]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ckgBnouH {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ckgBnouH" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d620da-215f-498d-b42a-c2975444e43e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ckgBnouH'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[424876ee-0f68-4009-b47d-f9e4f3e40c75]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2be8b-69fd-4746-ac0e-19ce9cbc988c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)
Nov 10 19:56:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)
Nov 10 19:56:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cadb9f-5560-47d5-9c2d-095e2c0249ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49, portal: 172.16.0.220,3260]
Nov 10 19:56:00 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49, portal: 172.16.0.220,3260] successful.
Nov 10 19:56:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f01406-af56-4792-9624-81e54aeb950d]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[103d59fd-9946-42a1-89d1-5f85aec9ad02]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)
Nov 10 19:56:00 user nova-compute[75026]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)
Nov 10 19:56:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)
Nov 10 19:56:00 user nova-compute[75026]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)
Nov 10 19:56:00 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4700626d-cf42-434a-9c8c-44f92149f975]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:00 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:56:01 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:56:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckgBnouH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:56:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:56:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23932383139343539', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:56:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932383139343539', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:56:01 user nova-compute[75026]: DEBUG nova.objects.instance [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'flavor' on Instance uuid 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:56:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:56:01 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:56:01 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:56:01 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:56:01 user nova-compute[75026]:   <serial>03de6683-0517-413e-8c9e-21841a6b9c49</serial>
Nov 10 19:56:01 user nova-compute[75026]: </disk>
Nov 10 19:56:01 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:56:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:56:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:56:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No VIF found with MAC fa:16:3e:dc:42:5c, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:56:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-53ab0efd-324c-4bab-a488-be13859ad5c2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.862s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:04 user nova-compute[75026]: INFO nova.compute.manager [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Detaching volume 03de6683-0517-413e-8c9e-21841a6b9c49
Nov 10 19:56:04 user nova-compute[75026]: INFO nova.virt.block_device [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Attempting to driver detach volume 03de6683-0517-413e-8c9e-21841a6b9c49 from mountpoint /dev/vdb
Nov 10 19:56:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Attempting to detach device vdb from instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:56:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:56:04 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:56:04 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:56:04 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:56:04 user nova-compute[75026]:   <serial>03de6683-0517-413e-8c9e-21841a6b9c49</serial>
Nov 10 19:56:04 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:56:04 user nova-compute[75026]: </disk>
Nov 10 19:56:04 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:56:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Successfully detached device vdb from instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 from the persistent domain config.
Nov 10 19:56:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:56:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:56:04 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:56:04 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 19:56:04 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:56:04 user nova-compute[75026]:   <serial>03de6683-0517-413e-8c9e-21841a6b9c49</serial>
Nov 10 19:56:04 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:56:04 user nova-compute[75026]: </disk>
Nov 10 19:56:04 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:56:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:05 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:56:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d852683-d701-472f-a089-ce5742ba3802 is timed out.
Nov 10 19:56:08 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully detached device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the live domain config.
Nov 10 19:56:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wyBkMxdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:56:08 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e775ac9-f883-4ce5-9f57-5f9267b24d3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:56:08 user nova-compute[75026]: No targets found.
Nov 10 19:56:08 user nova-compute[75026]: iSNS:
Nov 10 19:56:08 user nova-compute[75026]: No targets found.
Nov 10 19:56:08 user nova-compute[75026]: STATIC:
Nov 10 19:56:08 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea
Nov 10 19:56:08 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:56:08 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:56:08 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49
Nov 10 19:56:08 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:56:08 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:56:08 user nova-compute[75026]: FIRMWARE:
Nov 10 19:56:08 user nova-compute[75026]: No targets found.
Nov 10 19:56:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:56:08 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:56:08 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b0c1b5-06ec-4f23-b8de-ade280e99af2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[192a3583-3648-44be-9540-8461516125ae]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)
Nov 10 19:56:08 user nova-compute[75026]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)
Nov 10 19:56:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea (non-flash)
Nov 10 19:56:08 user nova-compute[75026]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)
Nov 10 19:56:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda02596c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810d23e-5249-4d42-97b7-154257f54b4d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee8b0f2-a46b-4dd8-9caa-564029a9ea9e]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f863959c-32ce-4a7a-93cf-82990d0a028e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0a8ba1-b3c0-41cb-93b0-0777b61de3c1]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e3cee7-8e7f-44f1-aa42-5070d1d7ca16]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0477327f-f977-4254-84ff-69d95c35517e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea, portal: 172.16.0.220,3260]
Nov 10 19:56:08 user nova-compute[75026]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea, portal: 172.16.0.220,3260] successful.
Nov 10 19:56:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9edf160-7bf9-4343-9dd0-0158fca556ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8716b4-8d67-46bb-9e8c-0e41f69b01c4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== disconnect_volume: return (285ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:56:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:56:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:56:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cd39d395-7278-4469-86a5-aea49b4704c6 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:56:12 user nova-compute[75026]: INFO nova.compute.claims [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Claim successful on node user
Nov 10 19:56:12 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:56:12 user nova-compute[75026]: DEBUG nova.network.neutron [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:56:12 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:56:12 user nova-compute[75026]: DEBUG nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG nova.policy [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0dd9bbcdce294a33b2692816caee276c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8508550b77e9441e939a122e28f723e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:56:13 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Creating image(s)
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.167s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk 1073741824" returned: 0 in 0.062s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG nova.network.neutron [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Successfully created port: ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Cannot resize image /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Ensure instance console log exists: /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:13 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Successfully updated port: ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquired lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-ad1ea6c4-ac5d-4e70-b79f-3ef712e4a493 req-5cd82fe0-5d3b-4701-8341-f23449393249 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-changed-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-ad1ea6c4-ac5d-4e70-b79f-3ef712e4a493 req-5cd82fe0-5d3b-4701-8341-f23449393249 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Refreshing instance network info cache due to event network-changed-ff283b79-3cdf-4b42-8cda-fdf4a30102c6. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ad1ea6c4-ac5d-4e70-b79f-3ef712e4a493 req-5cd82fe0-5d3b-4701-8341-f23449393249 service nova] Acquiring lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating instance_info_cache with network_info: [{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Releasing lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance network_info: |[{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ad1ea6c4-ac5d-4e70-b79f-3ef712e4a493 req-5cd82fe0-5d3b-4701-8341-f23449393249 service nova] Acquired lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.neutron [req-ad1ea6c4-ac5d-4e70-b79f-3ef712e4a493 req-5cd82fe0-5d3b-4701-8341-f23449393249 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Refreshing network info cache for port ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Start _get_guest_xml network_info=[{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:56:14 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:56:14 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1392156464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1392156464',id=47,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt1SMKNVbZrZWCG0xgTQygNymmKeSU4Aj6mxH4Q/QYsYpPf9JJt+AVy9UYfFTJyftOU7x5GA2nwK7BDxaM/LbBcUQ6EHUl+V9IRJC79d31XyLm9XRHTunobb7mIr5Xj6g==',key_name='tempest-keypair-1626589778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-34qz5faz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=c73e0db5-dc93-428f-bb36-eb42103e35ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.objects.instance [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'pci_devices' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:56:14 user nova-compute[75026]:   <uuid>c73e0db5-dc93-428f-bb36-eb42103e35ef</uuid>
Nov 10 19:56:14 user nova-compute[75026]:   <name>instance-0000002f</name>
Nov 10 19:56:14 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:56:14 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:56:14 user nova-compute[75026]:   <metadata>
Nov 10 19:56:14 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:56:14 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:56:14 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1392156464</nova:name>
Nov 10 19:56:14 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:56:14</nova:creationTime>
Nov 10 19:56:14 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:56:14 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:56:14 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:56:14 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:56:14 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:56:14 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:56:14 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:56:14 user nova-compute[75026]:       <nova:owner>
Nov 10 19:56:14 user nova-compute[75026]:         <nova:user uuid="0dd9bbcdce294a33b2692816caee276c">tempest-AttachVolumeShelveTestJSON-2009638513-project-member</nova:user>
Nov 10 19:56:14 user nova-compute[75026]:         <nova:project uuid="8508550b77e9441e939a122e28f723e5">tempest-AttachVolumeShelveTestJSON-2009638513</nova:project>
Nov 10 19:56:14 user nova-compute[75026]:       </nova:owner>
Nov 10 19:56:14 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:56:14 user nova-compute[75026]:       <nova:ports>
Nov 10 19:56:14 user nova-compute[75026]:         <nova:port uuid="ff283b79-3cdf-4b42-8cda-fdf4a30102c6">
Nov 10 19:56:14 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:56:14 user nova-compute[75026]:         </nova:port>
Nov 10 19:56:14 user nova-compute[75026]:       </nova:ports>
Nov 10 19:56:14 user nova-compute[75026]:     </nova:instance>
Nov 10 19:56:14 user nova-compute[75026]:   </metadata>
Nov 10 19:56:14 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:56:14 user nova-compute[75026]:     <system>
Nov 10 19:56:14 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:56:14 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:56:14 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:56:14 user nova-compute[75026]:       <entry name="serial">c73e0db5-dc93-428f-bb36-eb42103e35ef</entry>
Nov 10 19:56:14 user nova-compute[75026]:       <entry name="uuid">c73e0db5-dc93-428f-bb36-eb42103e35ef</entry>
Nov 10 19:56:14 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:56:14 user nova-compute[75026]:     </system>
Nov 10 19:56:14 user nova-compute[75026]:   </sysinfo>
Nov 10 19:56:14 user nova-compute[75026]:   <os>
Nov 10 19:56:14 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:56:14 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:56:14 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:56:14 user nova-compute[75026]:   </os>
Nov 10 19:56:14 user nova-compute[75026]:   <features>
Nov 10 19:56:14 user nova-compute[75026]:     <acpi/>
Nov 10 19:56:14 user nova-compute[75026]:     <apic/>
Nov 10 19:56:14 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:56:14 user nova-compute[75026]:   </features>
Nov 10 19:56:14 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:56:14 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:56:14 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:56:14 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:56:14 user nova-compute[75026]:   </clock>
Nov 10 19:56:14 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:56:14 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:56:14 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:56:14 user nova-compute[75026]:   </cpu>
Nov 10 19:56:14 user nova-compute[75026]:   <devices>
Nov 10 19:56:14 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:56:14 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:56:14 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk"/>
Nov 10 19:56:14 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:56:14 user nova-compute[75026]:     </disk>
Nov 10 19:56:14 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:56:14 user nova-compute[75026]:       <mac address="fa:16:3e:d1:62:45"/>
Nov 10 19:56:14 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:56:14 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:56:14 user nova-compute[75026]:       <target dev="tapff283b79-3c"/>
Nov 10 19:56:14 user nova-compute[75026]:     </interface>
Nov 10 19:56:14 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:56:14 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/console.log" append="off"/>
Nov 10 19:56:14 user nova-compute[75026]:     </serial>
Nov 10 19:56:14 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:56:14 user nova-compute[75026]:     <video>
Nov 10 19:56:14 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:56:14 user nova-compute[75026]:     </video>
Nov 10 19:56:14 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:56:14 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:56:14 user nova-compute[75026]:     </rng>
Nov 10 19:56:14 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:56:14 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:56:14 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:56:14 user nova-compute[75026]:     </memballoon>
Nov 10 19:56:14 user nova-compute[75026]:   </devices>
Nov 10 19:56:14 user nova-compute[75026]: </domain>
Nov 10 19:56:14 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1392156464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1392156464',id=47,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt1SMKNVbZrZWCG0xgTQygNymmKeSU4Aj6mxH4Q/QYsYpPf9JJt+AVy9UYfFTJyftOU7x5GA2nwK7BDxaM/LbBcUQ6EHUl+V9IRJC79d31XyLm9XRHTunobb7mIr5Xj6g==',key_name='tempest-keypair-1626589778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-34qz5faz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=c73e0db5-dc93-428f-bb36-eb42103e35ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG os_vif [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57da57ed-e67e-5fd5-a57d-26d2775a69f1', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff283b79-3c, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff283b79-3c, col_values=(('qos', UUID('cc26d784-b079-4d85-9e1f-f51be935d345')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff283b79-3c, col_values=(('external_ids', {'iface-id': 'ff283b79-3cdf-4b42-8cda-fdf4a30102c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:62:45', 'vm-uuid': 'c73e0db5-dc93-428f-bb36-eb42103e35ef'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:14 user nova-compute[75026]: INFO os_vif [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c')
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:56:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No VIF found with MAC fa:16:3e:d1:62:45, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:56:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-ad1ea6c4-ac5d-4e70-b79f-3ef712e4a493 req-5cd82fe0-5d3b-4701-8341-f23449393249 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updated VIF entry in instance network info cache for port ff283b79-3cdf-4b42-8cda-fdf4a30102c6. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:56:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-ad1ea6c4-ac5d-4e70-b79f-3ef712e4a493 req-5cd82fe0-5d3b-4701-8341-f23449393249 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating instance_info_cache with network_info: [{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:56:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ad1ea6c4-ac5d-4e70-b79f-3ef712e4a493 req-5cd82fe0-5d3b-4701-8341-f23449393249 service nova] Releasing lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-4b795a0f-223a-4c32-b4fb-6594b44547e0 req-3514f3b6-5183-467d-ad0c-b88bf3027f82 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4b795a0f-223a-4c32-b4fb-6594b44547e0 req-3514f3b6-5183-467d-ad0c-b88bf3027f82 service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4b795a0f-223a-4c32-b4fb-6594b44547e0 req-3514f3b6-5183-467d-ad0c-b88bf3027f82 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-4b795a0f-223a-4c32-b4fb-6594b44547e0 req-3514f3b6-5183-467d-ad0c-b88bf3027f82 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-4b795a0f-223a-4c32-b4fb-6594b44547e0 req-3514f3b6-5183-467d-ad0c-b88bf3027f82 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:56:16 user nova-compute[75026]: WARNING nova.compute.manager [req-4b795a0f-223a-4c32-b4fb-6594b44547e0 req-3514f3b6-5183-467d-ad0c-b88bf3027f82 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state building and task_state spawning.
Nov 10 19:56:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:56:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance spawned successfully.
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:56:18 user nova-compute[75026]: INFO nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:56:18 user nova-compute[75026]: INFO nova.compute.manager [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Took 5.80 seconds to build instance.
Nov 10 19:56:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-880f7b22-04d7-4a7d-87f0-3ec1646b7b13 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.892s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-13fc005a-90e9-40a7-932a-d886f8a1c107 req-7bda2bb5-824d-4240-8292-e12b9a599fc1 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-13fc005a-90e9-40a7-932a-d886f8a1c107 req-7bda2bb5-824d-4240-8292-e12b9a599fc1 service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-13fc005a-90e9-40a7-932a-d886f8a1c107 req-7bda2bb5-824d-4240-8292-e12b9a599fc1 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-13fc005a-90e9-40a7-932a-d886f8a1c107 req-7bda2bb5-824d-4240-8292-e12b9a599fc1 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:18 user nova-compute[75026]: DEBUG nova.compute.manager [req-13fc005a-90e9-40a7-932a-d886f8a1c107 req-7bda2bb5-824d-4240-8292-e12b9a599fc1 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:56:18 user nova-compute[75026]: WARNING nova.compute.manager [req-13fc005a-90e9-40a7-932a-d886f8a1c107 req-7bda2bb5-824d-4240-8292-e12b9a599fc1 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state active and task_state None.
Nov 10 19:56:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:56:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:56:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:56:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:56:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:25 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 is timed out.
Nov 10 19:56:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Successfully detached device vdb from instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 from the live domain config.
Nov 10 19:56:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckgBnouH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:56:25 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98d3f73-3a7b-4188-92df-d3dba08af8d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:56:25 user nova-compute[75026]: No targets found.
Nov 10 19:56:25 user nova-compute[75026]: iSNS:
Nov 10 19:56:25 user nova-compute[75026]: No targets found.
Nov 10 19:56:25 user nova-compute[75026]: STATIC:
Nov 10 19:56:25 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49
Nov 10 19:56:25 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:56:25 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:56:25 user nova-compute[75026]: FIRMWARE:
Nov 10 19:56:25 user nova-compute[75026]: No targets found.
Nov 10 19:56:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:56:25 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:56:25 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaca5d34-2520-44e8-a86a-6267d5cd70cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf8eb0c-51e7-45d3-accb-8f3fc426beff]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)
Nov 10 19:56:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 (non-flash)
Nov 10 19:56:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed98130310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9770607c-f22b-40fc-96ab-707fc06da6b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7186870-b705-40c7-a604-f992c3993bd9]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f4f53a-da19-4793-8cdb-34221562979e]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abcfc8b-41a4-47ae-9390-2b9f9d1de3c1]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c86a8f1-2d40-45ad-b8ff-a505be26b844]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: INFO nova.compute.manager [None req-d6aeda83-a42d-43e3-8a8b-ae95eaca6006 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Unrescuing
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6aeda83-a42d-43e3-8a8b-ae95eaca6006 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6aeda83-a42d-43e3-8a8b-ae95eaca6006 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d6aeda83-a42d-43e3-8a8b-ae95eaca6006 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eef453-baf8-4341-8174-15e9493cd33b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49, portal: 172.16.0.220,3260]
Nov 10 19:56:25 user nova-compute[75026]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49, portal: 172.16.0.220,3260] successful.
Nov 10 19:56:25 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03de6683-0517-413e-8c9e-21841a6b9c49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c1203f-cc0c-4a70-bb8f-020066a06fdf]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] <== disconnect_volume: return (299ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-d6aeda83-a42d-43e3-8a8b-ae95eaca6006 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-d6aeda83-a42d-43e3-8a8b-ae95eaca6006 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:56:25 user nova-compute[75026]: DEBUG nova.objects.instance [None req-d6aeda83-a42d-43e3-8a8b-ae95eaca6006 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'flavor' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-ff05ee2a-1226-4773-ba3b-fab97b6a58c4 req-38c20448-bfa7-49f6-9500-c1070a6d8949 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ff05ee2a-1226-4773-ba3b-fab97b6a58c4 req-38c20448-bfa7-49f6-9500-c1070a6d8949 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ff05ee2a-1226-4773-ba3b-fab97b6a58c4 req-38c20448-bfa7-49f6-9500-c1070a6d8949 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ff05ee2a-1226-4773-ba3b-fab97b6a58c4 req-38c20448-bfa7-49f6-9500-c1070a6d8949 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-ff05ee2a-1226-4773-ba3b-fab97b6a58c4 req-38c20448-bfa7-49f6-9500-c1070a6d8949 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:56:26 user nova-compute[75026]: WARNING nova.compute.manager [req-ff05ee2a-1226-4773-ba3b-fab97b6a58c4 req-38c20448-bfa7-49f6-9500-c1070a6d8949 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:56:26 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance destroyed successfully.
Nov 10 19:56:26 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'flavor' on Instance uuid 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:56:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1bd9c21b-5a87-4a30-95e3-86836378d6b2 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.085s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:56:28 user nova-compute[75026]: WARNING nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:56:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:56:28 user nova-compute[75026]: WARNING nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:56:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:56:28 user nova-compute[75026]: WARNING nova.compute.manager [req-f2a1aa62-cc64-4a7b-9ded-2e3ff3ae950e req-fedcb16b-587a-47ef-a30e-b444ca85a235 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state rescued and task_state unrescuing.
Nov 10 19:56:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-d6aeda83-a42d-43e3-8a8b-ae95eaca6006 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:56:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:37 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updating instance_info_cache with network_info: [{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:38 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:41 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:56:41 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8366MB free_disk=25.168476104736328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c73e0db5-dc93-428f-bb36-eb42103e35ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:56:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:56:44 user nova-compute[75026]: INFO nova.compute.manager [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attaching volume 2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e to /dev/vdb
Nov 10 19:56:44 user nova-compute[75026]: DEBUG os_brick.utils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[590dd319-2df1-4595-a7b7-00805fbfb2a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2495adba-f29f-4899-b45f-b75f46f4e77e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d26dea4-9ac8-46bc-8915-ba71cab10b93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[243a2471-628f-455e-834d-2d07f0ca657f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:56:44 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:56:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7244171-e2db-4f44-930a-ad33b24a1897]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG os_brick.utils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating existing volume attachment record: 30a82096-b384-4ba7-ad19-4c61a6cc8dd6 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:56:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:56:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:56:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:56:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:57:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:57:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:57:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:57:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:57:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:57:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:57:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:57:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:57:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:57:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:57:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtacYkyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:57:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:57:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:57:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:57:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:57:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:57:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:57:18 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:57:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ef1bec-f89b-478b-b4bb-2d0e39258bac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:57:19 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56e1f5a-972e-4b28-b3c1-b7fa1aa71bbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e] added
Nov 10 19:57:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a29b89-04f0-442d-a342-1c81a3e71172]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[088f2499-e40a-4f48-b1b8-aa045fd9d423]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtacYkyM {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtacYkyM" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2e69e3-2348-4ada-940a-3356c56603ac]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KtacYkyM'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5b40a7-0054-488f-8d1d-481c500b7c66]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e70e14-eb0d-450d-84a5-2465d693818f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:57:19 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:57:19 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:57:19 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:57:19 user nova-compute[75026]: 
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9fdcda-bcda-48d3-894e-1714db32c37e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e, portal: 172.16.0.220,3260]
Nov 10 19:57:19 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e, portal: 172.16.0.220,3260] successful.
Nov 10 19:57:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eccc9f4-8fd7-402e-8f4e-b014512f9e95]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1dee56-5ab1-4589-b98c-76d702a96c50]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e (non-flash)
Nov 10 19:57:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e (non-flash)
Nov 10 19:57:19 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1773fca-03c8-442a-b303-88caf63155e1]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtacYkyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:57:19 user nova-compute[75026]: DEBUG nova.compute.manager [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:57:19 user nova-compute[75026]: INFO nova.compute.manager [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] instance snapshotting
Nov 10 19:57:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:19 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Beginning live snapshot process
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json -f qcow2 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26638333530636333', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333530636333', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG nova.objects.instance [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:57:20 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:57:20 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:57:20 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:57:20 user nova-compute[75026]:   <serial>2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e</serial>
Nov 10 19:57:20 user nova-compute[75026]: </disk>
Nov 10 19:57:20 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json -f qcow2 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.166s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp95dew5tz/dc3886c8500a486381b3987587c2513d.delta 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp95dew5tz/dc3886c8500a486381b3987587c2513d.delta 1073741824" returned: 0 in 0.056s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:20 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 19:57:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No VIF found with MAC fa:16:3e:4f:c9:a3, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:57:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-2d969102-c91e-4680-96da-4b49317dcff8 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.284s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:57:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 19:57:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 19:57:22 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:57:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp95dew5tz/dc3886c8500a486381b3987587c2513d.delta /opt/stack/data/nova/instances/snapshots/tmp95dew5tz/dc3886c8500a486381b3987587c2513d {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp95dew5tz/dc3886c8500a486381b3987587c2513d.delta /opt/stack/data/nova/instances/snapshots/tmp95dew5tz/dc3886c8500a486381b3987587c2513d" returned: 0 in 0.503s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:22 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Snapshot extracted, beginning image upload
Nov 10 19:57:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:23 user nova-compute[75026]: INFO nova.compute.manager [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Detaching volume 2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e
Nov 10 19:57:23 user nova-compute[75026]: INFO nova.virt.block_device [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attempting to driver detach volume 2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e from mountpoint /dev/vdb
Nov 10 19:57:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Attempting to detach device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:57:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:57:23 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:57:23 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:57:23 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:57:23 user nova-compute[75026]:   <serial>2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e</serial>
Nov 10 19:57:23 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:57:23 user nova-compute[75026]: </disk>
Nov 10 19:57:23 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:57:23 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully detached device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the persistent domain config.
Nov 10 19:57:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d852683-d701-472f-a089-ce5742ba3802 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:57:23 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:57:23 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:57:23 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:57:23 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:57:23 user nova-compute[75026]:   <serial>2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e</serial>
Nov 10 19:57:23 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:57:23 user nova-compute[75026]: </disk>
Nov 10 19:57:23 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:57:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:57:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Snapshot image upload complete
Nov 10 19:57:25 user nova-compute[75026]: INFO nova.compute.manager [None req-eaecc1d8-6c7e-494e-938f-4b538fdc6f71 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Took 5.10 seconds to snapshot the instance on the hypervisor.
Nov 10 19:57:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:57:27 user nova-compute[75026]: INFO nova.compute.claims [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Claim successful on node user
Nov 10 19:57:27 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:57:27 user nova-compute[75026]: DEBUG nova.network.neutron [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:57:27 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:57:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:57:28 user nova-compute[75026]: DEBUG nova.policy [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd6c5920b28543ab859267ec7278b317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7586dc2316c4a26b8a23491f430d07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:57:28 user nova-compute[75026]: DEBUG nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:57:28 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:57:28 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Creating image(s)
Nov 10 19:57:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "/opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "/opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "86f47fb9c15879441bbe628535a73f767dc8a4b8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "86f47fb9c15879441bbe628535a73f767dc8a4b8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Successfully created port: ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:57:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:29 user nova-compute[75026]: DEBUG nova.virt.images [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] 7c064d56-61d6-4d7f-bf34-f65b27824f9e was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 19:57:29 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:57:29 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8.part /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8.part /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8.converted" returned: 0 in 1.050s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Successfully updated port: ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01f6cd3-6e5c-4fde-8029-ffaf0ded4cc8 req-c20e729c-9e6a-443a-bdb0-c33c4fd76147 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received event network-changed-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-a01f6cd3-6e5c-4fde-8029-ffaf0ded4cc8 req-c20e729c-9e6a-443a-bdb0-c33c4fd76147 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Refreshing instance network info cache due to event network-changed-ae0dedd5-22e5-4316-bf0b-2b78aab9038e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01f6cd3-6e5c-4fde-8029-ffaf0ded4cc8 req-c20e729c-9e6a-443a-bdb0-c33c4fd76147 service nova] Acquiring lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01f6cd3-6e5c-4fde-8029-ffaf0ded4cc8 req-c20e729c-9e6a-443a-bdb0-c33c4fd76147 service nova] Acquired lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-a01f6cd3-6e5c-4fde-8029-ffaf0ded4cc8 req-c20e729c-9e6a-443a-bdb0-c33c4fd76147 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Refreshing network info cache for port ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-a01f6cd3-6e5c-4fde-8029-ffaf0ded4cc8 req-c20e729c-9e6a-443a-bdb0-c33c4fd76147 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "86f47fb9c15879441bbe628535a73f767dc8a4b8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.436s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG nova.network.neutron [req-a01f6cd3-6e5c-4fde-8029-ffaf0ded4cc8 req-c20e729c-9e6a-443a-bdb0-c33c4fd76147 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a01f6cd3-6e5c-4fde-8029-ffaf0ded4cc8 req-c20e729c-9e6a-443a-bdb0-c33c4fd76147 service nova] Releasing lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquired lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8 --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "86f47fb9c15879441bbe628535a73f767dc8a4b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "86f47fb9c15879441bbe628535a73f767dc8a4b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8 --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8,backing_fmt=raw /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8,backing_fmt=raw /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk 1073741824" returned: 0 in 0.051s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "86f47fb9c15879441bbe628535a73f767dc8a4b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Updating instance_info_cache with network_info: [{"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Releasing lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Instance network_info: |[{"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86f47fb9c15879441bbe628535a73f767dc8a4b8 --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Ensure instance console log exists: /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Start _get_guest_xml network_info=[{"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2cf691326fe5fbe8c48e9e8a9716586f',container_format='bare',created_at=2023-11-10T19:57:20Z,direct_url=<?>,disk_format='qcow2',id=7c064d56-61d6-4d7f-bf34-f65b27824f9e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-944190344',owner='d7586dc2316c4a26b8a23491f430d07e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T19:57:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': '7c064d56-61d6-4d7f-bf34-f65b27824f9e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:57:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:57:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2cf691326fe5fbe8c48e9e8a9716586f',container_format='bare',created_at=2023-11-10T19:57:20Z,direct_url=<?>,disk_format='qcow2',id=7c064d56-61d6-4d7f-bf34-f65b27824f9e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-944190344',owner='d7586dc2316c4a26b8a23491f430d07e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T19:57:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1817997594',display_name='tempest-TestStampPattern-server-1817997594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1817997594',id=48,image_ref='7c064d56-61d6-4d7f-bf34-f65b27824f9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgQJf+K5q9482jlgZcnbGU3mPdTxCa9QVlp+GK538Zi4nk447tX7z9aDvYXqC82MKGVm4iUZjP/MyQSczaZobWktrkPQfNgE3pr8E4SSuPbR+IHKrONBgSCKyqrJOCD3w==',key_name='tempest-TestStampPattern-3594168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7586dc2316c4a26b8a23491f430d07e',ramdisk_id='',reservation_id='r-6s26mt87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5b89c7bd-bb17-4b9d-a4b2-02cc5af21666',image_min_disk='1',image_min_ram='0',image_owner_id='d7586dc2316c4a26b8a23491f430d07e',image_owner_project_name='tempest-TestStampPattern-60453673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-60453673-project-member',image_user_id='bd6c5920b28543ab859267ec7278b317',network_allocated='True',owner_project_name='tempest-TestStampPattern-60453673',owner_user_name='tempest-TestStampPattern-60453673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:57:28Z,user_data=None,user_id='bd6c5920b28543ab859267ec7278b317',uuid=0e1cfe70-df7d-43e4-96a2-fec4758da456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converting VIF {"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:5e:02,bridge_name='br-int',has_traffic_filtering=True,id=ae0dedd5-22e5-4316-bf0b-2b78aab9038e,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0dedd5-22') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.objects.instance [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e1cfe70-df7d-43e4-96a2-fec4758da456 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:57:31 user nova-compute[75026]:   <uuid>0e1cfe70-df7d-43e4-96a2-fec4758da456</uuid>
Nov 10 19:57:31 user nova-compute[75026]:   <name>instance-00000030</name>
Nov 10 19:57:31 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:57:31 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:57:31 user nova-compute[75026]:   <metadata>
Nov 10 19:57:31 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:57:31 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:57:31 user nova-compute[75026]:       <nova:name>tempest-TestStampPattern-server-1817997594</nova:name>
Nov 10 19:57:31 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:57:31</nova:creationTime>
Nov 10 19:57:31 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:57:31 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:57:31 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:57:31 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:57:31 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:57:31 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:57:31 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:57:31 user nova-compute[75026]:       <nova:owner>
Nov 10 19:57:31 user nova-compute[75026]:         <nova:user uuid="bd6c5920b28543ab859267ec7278b317">tempest-TestStampPattern-60453673-project-member</nova:user>
Nov 10 19:57:31 user nova-compute[75026]:         <nova:project uuid="d7586dc2316c4a26b8a23491f430d07e">tempest-TestStampPattern-60453673</nova:project>
Nov 10 19:57:31 user nova-compute[75026]:       </nova:owner>
Nov 10 19:57:31 user nova-compute[75026]:       <nova:root type="image" uuid="7c064d56-61d6-4d7f-bf34-f65b27824f9e"/>
Nov 10 19:57:31 user nova-compute[75026]:       <nova:ports>
Nov 10 19:57:31 user nova-compute[75026]:         <nova:port uuid="ae0dedd5-22e5-4316-bf0b-2b78aab9038e">
Nov 10 19:57:31 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 19:57:31 user nova-compute[75026]:         </nova:port>
Nov 10 19:57:31 user nova-compute[75026]:       </nova:ports>
Nov 10 19:57:31 user nova-compute[75026]:     </nova:instance>
Nov 10 19:57:31 user nova-compute[75026]:   </metadata>
Nov 10 19:57:31 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:57:31 user nova-compute[75026]:     <system>
Nov 10 19:57:31 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:57:31 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:57:31 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:57:31 user nova-compute[75026]:       <entry name="serial">0e1cfe70-df7d-43e4-96a2-fec4758da456</entry>
Nov 10 19:57:31 user nova-compute[75026]:       <entry name="uuid">0e1cfe70-df7d-43e4-96a2-fec4758da456</entry>
Nov 10 19:57:31 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:57:31 user nova-compute[75026]:     </system>
Nov 10 19:57:31 user nova-compute[75026]:   </sysinfo>
Nov 10 19:57:31 user nova-compute[75026]:   <os>
Nov 10 19:57:31 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:57:31 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:57:31 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:57:31 user nova-compute[75026]:   </os>
Nov 10 19:57:31 user nova-compute[75026]:   <features>
Nov 10 19:57:31 user nova-compute[75026]:     <acpi/>
Nov 10 19:57:31 user nova-compute[75026]:     <apic/>
Nov 10 19:57:31 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:57:31 user nova-compute[75026]:   </features>
Nov 10 19:57:31 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:57:31 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:57:31 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:57:31 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:57:31 user nova-compute[75026]:   </clock>
Nov 10 19:57:31 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:57:31 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:57:31 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:57:31 user nova-compute[75026]:   </cpu>
Nov 10 19:57:31 user nova-compute[75026]:   <devices>
Nov 10 19:57:31 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:57:31 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:57:31 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk"/>
Nov 10 19:57:31 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:57:31 user nova-compute[75026]:     </disk>
Nov 10 19:57:31 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:57:31 user nova-compute[75026]:       <mac address="fa:16:3e:51:5e:02"/>
Nov 10 19:57:31 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:57:31 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:57:31 user nova-compute[75026]:       <target dev="tapae0dedd5-22"/>
Nov 10 19:57:31 user nova-compute[75026]:     </interface>
Nov 10 19:57:31 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:57:31 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/console.log" append="off"/>
Nov 10 19:57:31 user nova-compute[75026]:     </serial>
Nov 10 19:57:31 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:57:31 user nova-compute[75026]:     <video>
Nov 10 19:57:31 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:57:31 user nova-compute[75026]:     </video>
Nov 10 19:57:31 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:57:31 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:57:31 user nova-compute[75026]:     </rng>
Nov 10 19:57:31 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:57:31 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:57:31 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:57:31 user nova-compute[75026]:     </memballoon>
Nov 10 19:57:31 user nova-compute[75026]:   </devices>
Nov 10 19:57:31 user nova-compute[75026]: </domain>
Nov 10 19:57:31 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1817997594',display_name='tempest-TestStampPattern-server-1817997594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1817997594',id=48,image_ref='7c064d56-61d6-4d7f-bf34-f65b27824f9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgQJf+K5q9482jlgZcnbGU3mPdTxCa9QVlp+GK538Zi4nk447tX7z9aDvYXqC82MKGVm4iUZjP/MyQSczaZobWktrkPQfNgE3pr8E4SSuPbR+IHKrONBgSCKyqrJOCD3w==',key_name='tempest-TestStampPattern-3594168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7586dc2316c4a26b8a23491f430d07e',ramdisk_id='',reservation_id='r-6s26mt87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5b89c7bd-bb17-4b9d-a4b2-02cc5af21666',image_min_disk='1',image_min_ram='0',image_owner_id='d7586dc2316c4a26b8a23491f430d07e',image_owner_project_name='tempest-TestStampPattern-60453673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-60453673-project-member',image_user_id='bd6c5920b28543ab859267ec7278b317',network_allocated='True',owner_project_name='tempest-TestStampPattern-60453673',owner_user_name='tempest-TestStampPattern-60453673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:57:28Z,user_data=None,user_id='bd6c5920b28543ab859267ec7278b317',uuid=0e1cfe70-df7d-43e4-96a2-fec4758da456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converting VIF {"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:5e:02,bridge_name='br-int',has_traffic_filtering=True,id=ae0dedd5-22e5-4316-bf0b-2b78aab9038e,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0dedd5-22') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG os_vif [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:5e:02,bridge_name='br-int',has_traffic_filtering=True,id=ae0dedd5-22e5-4316-bf0b-2b78aab9038e,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0dedd5-22') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83b65e84-3142-55de-b029-07c0aed333f5', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae0dedd5-22, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae0dedd5-22, col_values=(('qos', UUID('364473a4-d3e2-4da8-8777-698d24227f7f')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae0dedd5-22, col_values=(('external_ids', {'iface-id': 'ae0dedd5-22e5-4316-bf0b-2b78aab9038e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:5e:02', 'vm-uuid': '0e1cfe70-df7d-43e4-96a2-fec4758da456'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:31 user nova-compute[75026]: INFO os_vif [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:5e:02,bridge_name='br-int',has_traffic_filtering=True,id=ae0dedd5-22e5-4316-bf0b-2b78aab9038e,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0dedd5-22')
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:57:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No VIF found with MAC fa:16:3e:51:5e:02, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-5ce9e71a-7da0-4cd2-8a6f-229e38812082 req-5079247d-104a-4c6b-b140-5f0c5d94ee68 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received event network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5ce9e71a-7da0-4cd2-8a6f-229e38812082 req-5079247d-104a-4c6b-b140-5f0c5d94ee68 service nova] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5ce9e71a-7da0-4cd2-8a6f-229e38812082 req-5079247d-104a-4c6b-b140-5f0c5d94ee68 service nova] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5ce9e71a-7da0-4cd2-8a6f-229e38812082 req-5079247d-104a-4c6b-b140-5f0c5d94ee68 service nova] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:32 user nova-compute[75026]: DEBUG nova.compute.manager [req-5ce9e71a-7da0-4cd2-8a6f-229e38812082 req-5079247d-104a-4c6b-b140-5f0c5d94ee68 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] No waiting events found dispatching network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:57:32 user nova-compute[75026]: WARNING nova.compute.manager [req-5ce9e71a-7da0-4cd2-8a6f-229e38812082 req-5079247d-104a-4c6b-b140-5f0c5d94ee68 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received unexpected event network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e for instance with vm_state building and task_state spawning.
Nov 10 19:57:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:57:34 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Instance spawned successfully.
Nov 10 19:57:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:34 user nova-compute[75026]: INFO nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Took 6.63 seconds to spawn the instance on the hypervisor.
Nov 10 19:57:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:57:34 user nova-compute[75026]: INFO nova.compute.manager [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Took 7.33 seconds to build instance.
Nov 10 19:57:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-102477b8-2c56-40c5-923f-0ee2b7f979e4 tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.473s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-597e4060-74ee-4866-ad01-1241f2c6c961 req-9e2d6021-e7a1-4f92-92af-30d62adf2a7b service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received event network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-597e4060-74ee-4866-ad01-1241f2c6c961 req-9e2d6021-e7a1-4f92-92af-30d62adf2a7b service nova] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-597e4060-74ee-4866-ad01-1241f2c6c961 req-9e2d6021-e7a1-4f92-92af-30d62adf2a7b service nova] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-597e4060-74ee-4866-ad01-1241f2c6c961 req-9e2d6021-e7a1-4f92-92af-30d62adf2a7b service nova] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-597e4060-74ee-4866-ad01-1241f2c6c961 req-9e2d6021-e7a1-4f92-92af-30d62adf2a7b service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] No waiting events found dispatching network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:57:34 user nova-compute[75026]: WARNING nova.compute.manager [req-597e4060-74ee-4866-ad01-1241f2c6c961 req-9e2d6021-e7a1-4f92-92af-30d62adf2a7b service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received unexpected event network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e for instance with vm_state active and task_state None.
Nov 10 19:57:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:37 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:57:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:57:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:57:37 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:57:38 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating instance_info_cache with network_info: [{"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:57:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-3d852683-d701-472f-a089-ce5742ba3802" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:57:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:57:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:39 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:57:39 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:42 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:57:42 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:57:42 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8332MB free_disk=25.02114486694336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:57:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:57:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c73e0db5-dc93-428f-bb36-eb42103e35ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:57:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d852683-d701-472f-a089-ce5742ba3802 is timed out.
Nov 10 19:57:44 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully detached device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the live domain config.
Nov 10 19:57:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtacYkyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:57:44 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[69236437-0aa8-4202-8454-15c1522357fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:57:44 user nova-compute[75026]: No targets found.
Nov 10 19:57:44 user nova-compute[75026]: iSNS:
Nov 10 19:57:44 user nova-compute[75026]: No targets found.
Nov 10 19:57:44 user nova-compute[75026]: STATIC:
Nov 10 19:57:44 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e
Nov 10 19:57:44 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:57:44 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:57:44 user nova-compute[75026]: FIRMWARE:
Nov 10 19:57:44 user nova-compute[75026]: No targets found.
Nov 10 19:57:44 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:57:44 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:57:44 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab3258f-2250-4d12-96de-2a6233304d92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bffa81-963c-4e4d-b8b0-e8282ab1ba6e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e (non-flash)
Nov 10 19:57:44 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e (non-flash)
Nov 10 19:57:44 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda025a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6ba6e0-2137-4b6a-baaa-809d0b8490d4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdabd953-8eb0-4970-bc11-97b80663abdf]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b40cf5-2571-4d21-822f-67c347d8452f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c99e5f4-9601-454c-9427-41b1527f5061]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d84a54-962f-41d6-a732-201b08d460ec]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d0a03c-cf95-41ba-8728-9ee0e11f750f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e, portal: 172.16.0.220,3260]
Nov 10 19:57:44 user nova-compute[75026]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e, portal: 172.16.0.220,3260] successful.
Nov 10 19:57:44 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e45a6fa-40d8-4dd0-b64b-94aaeed50f6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ca1a54-a54e-4ae5-9a8b-d9b7cefd9d9a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== disconnect_volume: return (279ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:57:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:57:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:57:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce798387-a38a-4d11-8949-c696def72fac tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.818s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:57:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:57:49 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:49 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:57:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:57:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:57:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 19:58:01 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 19:58:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-db7dea92-7ff7-48e4-a753-1db6ad139af0 req-f95697c1-9540-4039-be37-58044446f9ef service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-changed-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-db7dea92-7ff7-48e4-a753-1db6ad139af0 req-f95697c1-9540-4039-be37-58044446f9ef service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Refreshing instance network info cache due to event network-changed-ff283b79-3cdf-4b42-8cda-fdf4a30102c6. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:58:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-db7dea92-7ff7-48e4-a753-1db6ad139af0 req-f95697c1-9540-4039-be37-58044446f9ef service nova] Acquiring lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:58:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-db7dea92-7ff7-48e4-a753-1db6ad139af0 req-f95697c1-9540-4039-be37-58044446f9ef service nova] Acquired lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:58:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-db7dea92-7ff7-48e4-a753-1db6ad139af0 req-f95697c1-9540-4039-be37-58044446f9ef service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Refreshing network info cache for port ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:58:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-db7dea92-7ff7-48e4-a753-1db6ad139af0 req-f95697c1-9540-4039-be37-58044446f9ef service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updated VIF entry in instance network info cache for port ff283b79-3cdf-4b42-8cda-fdf4a30102c6. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:58:03 user nova-compute[75026]: DEBUG nova.network.neutron [req-db7dea92-7ff7-48e4-a753-1db6ad139af0 req-f95697c1-9540-4039-be37-58044446f9ef service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating instance_info_cache with network_info: [{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:58:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-db7dea92-7ff7-48e4-a753-1db6ad139af0 req-f95697c1-9540-4039-be37-58044446f9ef service nova] Releasing lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:58:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:10 user nova-compute[75026]: INFO nova.compute.manager [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Shelving
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-81e8c560-fbc3-4beb-8eb6-a926eea8e137 req-7ba7c1ec-38f6-4927-96d4-a35bce8a24d5 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-81e8c560-fbc3-4beb-8eb6-a926eea8e137 req-7ba7c1ec-38f6-4927-96d4-a35bce8a24d5 service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-81e8c560-fbc3-4beb-8eb6-a926eea8e137 req-7ba7c1ec-38f6-4927-96d4-a35bce8a24d5 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-81e8c560-fbc3-4beb-8eb6-a926eea8e137 req-7ba7c1ec-38f6-4927-96d4-a35bce8a24d5 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG nova.compute.manager [req-81e8c560-fbc3-4beb-8eb6-a926eea8e137 req-7ba7c1ec-38f6-4927-96d4-a35bce8a24d5 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:58:10 user nova-compute[75026]: WARNING nova.compute.manager [req-81e8c560-fbc3-4beb-8eb6-a926eea8e137 req-7ba7c1ec-38f6-4927-96d4-a35bce8a24d5 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state active and task_state shelving.
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:10 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance destroyed successfully.
Nov 10 19:58:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Beginning cold snapshot process
Nov 10 19:58:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk /opt/stack/data/nova/instances/snapshots/tmpaijmt3p6/d8b8512bc9d345d2b19cb7c7a0a069ad {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:11 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk /opt/stack/data/nova/instances/snapshots/tmpaijmt3p6/d8b8512bc9d345d2b19cb7c7a0a069ad" returned: 0 in 0.600s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:11 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Snapshot extracted, beginning image upload
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:58:12 user nova-compute[75026]: WARNING nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:58:12 user nova-compute[75026]: WARNING nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:58:12 user nova-compute[75026]: WARNING nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:58:12 user nova-compute[75026]: WARNING nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:58:12 user nova-compute[75026]: WARNING nova.compute.manager [req-8f641d92-5d0d-4b56-89c9-2aa88ccf2c64 req-917837e7-2ce4-4a02-a6f6-61be4560a9ec service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 19:58:13 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:13 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 19:58:14 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Snapshot image upload complete
Nov 10 19:58:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:58:14 user nova-compute[75026]: INFO nova.compute.manager [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Shelve offloading
Nov 10 19:58:14 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance destroyed successfully.
Nov 10 19:58:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:58:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:58:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquired lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:58:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:58:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:14 user nova-compute[75026]: DEBUG nova.network.neutron [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating instance_info_cache with network_info: [{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:58:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Releasing lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:58:15 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance destroyed successfully.
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.objects.instance [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'resources' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1392156464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1392156464',id=47,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt1SMKNVbZrZWCG0xgTQygNymmKeSU4Aj6mxH4Q/QYsYpPf9JJt+AVy9UYfFTJyftOU7x5GA2nwK7BDxaM/LbBcUQ6EHUl+V9IRJC79d31XyLm9XRHTunobb7mIr5Xj6g==',key_name='tempest-keypair-1626589778',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-34qz5faz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member',shelved_at='2023-11-10T19:58:14.309604',shelved_host='user',shelved_image_id='49702992-b16e-4414-97a5-69b147b7cec6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=c73e0db5-dc93-428f-bb36-eb42103e35ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG os_vif [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff283b79-3c, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc26d784-b079-4d85-9e1f-f51be935d345) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-154cc161-2dcf-4871-8c58-1c2d75bf3bde req-76913e0f-56d4-46b8-b3f5-9ddd51669ba2 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-changed-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-154cc161-2dcf-4871-8c58-1c2d75bf3bde req-76913e0f-56d4-46b8-b3f5-9ddd51669ba2 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Refreshing instance network info cache due to event network-changed-ff283b79-3cdf-4b42-8cda-fdf4a30102c6. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-154cc161-2dcf-4871-8c58-1c2d75bf3bde req-76913e0f-56d4-46b8-b3f5-9ddd51669ba2 service nova] Acquiring lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-154cc161-2dcf-4871-8c58-1c2d75bf3bde req-76913e0f-56d4-46b8-b3f5-9ddd51669ba2 service nova] Acquired lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-154cc161-2dcf-4871-8c58-1c2d75bf3bde req-76913e0f-56d4-46b8-b3f5-9ddd51669ba2 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Refreshing network info cache for port ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:58:15 user nova-compute[75026]: INFO os_vif [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c')
Nov 10 19:58:15 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Deleting instance files /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef_del
Nov 10 19:58:15 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Deletion of /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef_del complete
Nov 10 19:58:15 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Deleted allocations for instance c73e0db5-dc93-428f-bb36-eb42103e35ef
Nov 10 19:58:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.objects.instance [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'numa_topology' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.objects.base [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<c73e0db5-dc93-428f-bb36-eb42103e35ef> lazy-loaded attributes: resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-154cc161-2dcf-4871-8c58-1c2d75bf3bde req-76913e0f-56d4-46b8-b3f5-9ddd51669ba2 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updated VIF entry in instance network info cache for port ff283b79-3cdf-4b42-8cda-fdf4a30102c6. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-154cc161-2dcf-4871-8c58-1c2d75bf3bde req-76913e0f-56d4-46b8-b3f5-9ddd51669ba2 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating instance_info_cache with network_info: [{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapff283b79-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-154cc161-2dcf-4871-8c58-1c2d75bf3bde req-76913e0f-56d4-46b8-b3f5-9ddd51669ba2 service nova] Releasing lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-44d2008d-edb4-473c-8911-75eef9ae68ce tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.494s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:17 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG nova.objects.instance [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:19 user nova-compute[75026]: INFO nova.compute.manager [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attaching volume 0f663709-e6cd-4bd4-8310-d44156f98b38 to /dev/vdb
Nov 10 19:58:19 user nova-compute[75026]: DEBUG os_brick.utils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0544293-b2c0-434b-a5ae-2c35e1a6d30f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d46d9fb-d207-478d-b9c9-00ff2a8975f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[543414a5-abe6-4804-aac8-82b9d9ce34f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbbc2aa-c071-4ed9-a75f-30fd354d2be3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:58:20 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:58:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ad8748-1408-42cd-b302-4152bed42951]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG os_brick.utils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating existing volume attachment record: f96e56a9-9cc2-461b-9985-a1bc17c6700c {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:58:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 19:58:24 user nova-compute[75026]: INFO nova.compute.claims [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Claim successful on node user
Nov 10 19:58:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 19:58:24 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 19:58:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 19:58:24 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG nova.policy [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7ef73abaece4f08b00d81d403a8a66a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d8f446a3094348839f9216faff0485', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 19:58:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Creating image(s)
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk 1073741824" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.200s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Successfully created port: b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Cannot resize image /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Ensure instance console log exists: /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Successfully updated port: b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquired lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-613dd74a-2ec7-482e-8fa6-c0a16f662a76 req-a6d304c9-55f8-4dc4-8601-93c141e6989c service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-changed-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-613dd74a-2ec7-482e-8fa6-c0a16f662a76 req-a6d304c9-55f8-4dc4-8601-93c141e6989c service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Refreshing instance network info cache due to event network-changed-b924fdef-09ba-41ab-b72c-757a4ed14a64. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-613dd74a-2ec7-482e-8fa6-c0a16f662a76 req-a6d304c9-55f8-4dc4-8601-93c141e6989c service nova] Acquiring lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Releasing lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance network_info: |[{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-613dd74a-2ec7-482e-8fa6-c0a16f662a76 req-a6d304c9-55f8-4dc4-8601-93c141e6989c service nova] Acquired lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-613dd74a-2ec7-482e-8fa6-c0a16f662a76 req-a6d304c9-55f8-4dc4-8601-93c141e6989c service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Refreshing network info cache for port b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Start _get_guest_xml network_info=[{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 19:58:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:58:26 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-943681264',display_name='tempest-ServerRescueNegativeTestJSON-server-943681264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-943681264',id=49,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYMM+R8cnyQrOlyL+/tho6trX/akyP2QOOF40b/FXBOeSXJW/q3xViduU9BybQAJists388l16o9gc6iO7kloKaRU/YalCEiIYQMmAfPzTAwtnsIgv5K1hLgEsyz8XftQ==',key_name='tempest-keypair-1041471018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-jve2rikm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=15886f5c-4c07-4506-8f6d-fc9124ed2fe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=b924fdef-09ba-41ab-b72c-757a4ed14a64,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924fdef-09') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'pci_devices' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 19:58:26 user nova-compute[75026]:   <uuid>15886f5c-4c07-4506-8f6d-fc9124ed2fe6</uuid>
Nov 10 19:58:26 user nova-compute[75026]:   <name>instance-00000031</name>
Nov 10 19:58:26 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 19:58:26 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 19:58:26 user nova-compute[75026]:   <metadata>
Nov 10 19:58:26 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 19:58:26 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 19:58:26 user nova-compute[75026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-943681264</nova:name>
Nov 10 19:58:26 user nova-compute[75026]:       <nova:creationTime>2023-11-10 19:58:26</nova:creationTime>
Nov 10 19:58:26 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 19:58:26 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 19:58:26 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 19:58:26 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 19:58:26 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 19:58:26 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 19:58:26 user nova-compute[75026]:       </nova:flavor>
Nov 10 19:58:26 user nova-compute[75026]:       <nova:owner>
Nov 10 19:58:26 user nova-compute[75026]:         <nova:user uuid="b7ef73abaece4f08b00d81d403a8a66a">tempest-ServerRescueNegativeTestJSON-1130240525-project-member</nova:user>
Nov 10 19:58:26 user nova-compute[75026]:         <nova:project uuid="64d8f446a3094348839f9216faff0485">tempest-ServerRescueNegativeTestJSON-1130240525</nova:project>
Nov 10 19:58:26 user nova-compute[75026]:       </nova:owner>
Nov 10 19:58:26 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 19:58:26 user nova-compute[75026]:       <nova:ports>
Nov 10 19:58:26 user nova-compute[75026]:         <nova:port uuid="b924fdef-09ba-41ab-b72c-757a4ed14a64">
Nov 10 19:58:26 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 19:58:26 user nova-compute[75026]:         </nova:port>
Nov 10 19:58:26 user nova-compute[75026]:       </nova:ports>
Nov 10 19:58:26 user nova-compute[75026]:     </nova:instance>
Nov 10 19:58:26 user nova-compute[75026]:   </metadata>
Nov 10 19:58:26 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 19:58:26 user nova-compute[75026]:     <system>
Nov 10 19:58:26 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 19:58:26 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 19:58:26 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 19:58:26 user nova-compute[75026]:       <entry name="serial">15886f5c-4c07-4506-8f6d-fc9124ed2fe6</entry>
Nov 10 19:58:26 user nova-compute[75026]:       <entry name="uuid">15886f5c-4c07-4506-8f6d-fc9124ed2fe6</entry>
Nov 10 19:58:26 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 19:58:26 user nova-compute[75026]:     </system>
Nov 10 19:58:26 user nova-compute[75026]:   </sysinfo>
Nov 10 19:58:26 user nova-compute[75026]:   <os>
Nov 10 19:58:26 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 19:58:26 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 19:58:26 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 19:58:26 user nova-compute[75026]:   </os>
Nov 10 19:58:26 user nova-compute[75026]:   <features>
Nov 10 19:58:26 user nova-compute[75026]:     <acpi/>
Nov 10 19:58:26 user nova-compute[75026]:     <apic/>
Nov 10 19:58:26 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 19:58:26 user nova-compute[75026]:   </features>
Nov 10 19:58:26 user nova-compute[75026]:   <clock offset="utc">
Nov 10 19:58:26 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 19:58:26 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 19:58:26 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 19:58:26 user nova-compute[75026]:   </clock>
Nov 10 19:58:26 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 19:58:26 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 19:58:26 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 19:58:26 user nova-compute[75026]:   </cpu>
Nov 10 19:58:26 user nova-compute[75026]:   <devices>
Nov 10 19:58:26 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 19:58:26 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 19:58:26 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk"/>
Nov 10 19:58:26 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 19:58:26 user nova-compute[75026]:     </disk>
Nov 10 19:58:26 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 19:58:26 user nova-compute[75026]:       <mac address="fa:16:3e:98:ca:6a"/>
Nov 10 19:58:26 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:58:26 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 19:58:26 user nova-compute[75026]:       <target dev="tapb924fdef-09"/>
Nov 10 19:58:26 user nova-compute[75026]:     </interface>
Nov 10 19:58:26 user nova-compute[75026]:     <serial type="pty">
Nov 10 19:58:26 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/console.log" append="off"/>
Nov 10 19:58:26 user nova-compute[75026]:     </serial>
Nov 10 19:58:26 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 19:58:26 user nova-compute[75026]:     <video>
Nov 10 19:58:26 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 19:58:26 user nova-compute[75026]:     </video>
Nov 10 19:58:26 user nova-compute[75026]:     <rng model="virtio">
Nov 10 19:58:26 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 19:58:26 user nova-compute[75026]:     </rng>
Nov 10 19:58:26 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 19:58:26 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 19:58:26 user nova-compute[75026]:       <stats period="10"/>
Nov 10 19:58:26 user nova-compute[75026]:     </memballoon>
Nov 10 19:58:26 user nova-compute[75026]:   </devices>
Nov 10 19:58:26 user nova-compute[75026]: </domain>
Nov 10 19:58:26 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-943681264',display_name='tempest-ServerRescueNegativeTestJSON-server-943681264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-943681264',id=49,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYMM+R8cnyQrOlyL+/tho6trX/akyP2QOOF40b/FXBOeSXJW/q3xViduU9BybQAJists388l16o9gc6iO7kloKaRU/YalCEiIYQMmAfPzTAwtnsIgv5K1hLgEsyz8XftQ==',key_name='tempest-keypair-1041471018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-jve2rikm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=15886f5c-4c07-4506-8f6d-fc9124ed2fe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=b924fdef-09ba-41ab-b72c-757a4ed14a64,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924fdef-09') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG os_vif [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=b924fdef-09ba-41ab-b72c-757a4ed14a64,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924fdef-09') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b022e704-e4cf-571b-ba6c-a1f2f57ef273', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb924fdef-09, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb924fdef-09, col_values=(('qos', UUID('7e6a43f4-dc81-47d1-ae88-0a58b9b61cc8')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb924fdef-09, col_values=(('external_ids', {'iface-id': 'b924fdef-09ba-41ab-b72c-757a4ed14a64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:ca:6a', 'vm-uuid': '15886f5c-4c07-4506-8f6d-fc9124ed2fe6'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:26 user nova-compute[75026]: INFO os_vif [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=b924fdef-09ba-41ab-b72c-757a4ed14a64,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924fdef-09')
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:58:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No VIF found with MAC fa:16:3e:98:ca:6a, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:58:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-613dd74a-2ec7-482e-8fa6-c0a16f662a76 req-a6d304c9-55f8-4dc4-8601-93c141e6989c service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updated VIF entry in instance network info cache for port b924fdef-09ba-41ab-b72c-757a4ed14a64. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:58:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-613dd74a-2ec7-482e-8fa6-c0a16f662a76 req-a6d304c9-55f8-4dc4-8601-93c141e6989c service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:58:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-613dd74a-2ec7-482e-8fa6-c0a16f662a76 req-a6d304c9-55f8-4dc4-8601-93c141e6989c service nova] Releasing lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:58:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-a73ec731-8e83-411f-8406-809df2d82f71 req-67e3ad2e-89e2-4e03-8a9e-fdf197b62d13 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a73ec731-8e83-411f-8406-809df2d82f71 req-67e3ad2e-89e2-4e03-8a9e-fdf197b62d13 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a73ec731-8e83-411f-8406-809df2d82f71 req-67e3ad2e-89e2-4e03-8a9e-fdf197b62d13 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-a73ec731-8e83-411f-8406-809df2d82f71 req-67e3ad2e-89e2-4e03-8a9e-fdf197b62d13 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-a73ec731-8e83-411f-8406-809df2d82f71 req-67e3ad2e-89e2-4e03-8a9e-fdf197b62d13 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:58:28 user nova-compute[75026]: WARNING nova.compute.manager [req-a73ec731-8e83-411f-8406-809df2d82f71 req-67e3ad2e-89e2-4e03-8a9e-fdf197b62d13 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state building and task_state spawning.
Nov 10 19:58:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 19:58:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance spawned successfully.
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 19:58:30 user nova-compute[75026]: INFO nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-090b0636-a842-413c-84dd-72cee026df73 req-e8a4cca8-2053-422f-a20f-2c391976f3ce service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-090b0636-a842-413c-84dd-72cee026df73 req-e8a4cca8-2053-422f-a20f-2c391976f3ce service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-090b0636-a842-413c-84dd-72cee026df73 req-e8a4cca8-2053-422f-a20f-2c391976f3ce service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-090b0636-a842-413c-84dd-72cee026df73 req-e8a4cca8-2053-422f-a20f-2c391976f3ce service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:30 user nova-compute[75026]: DEBUG nova.compute.manager [req-090b0636-a842-413c-84dd-72cee026df73 req-e8a4cca8-2053-422f-a20f-2c391976f3ce service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 19:58:30 user nova-compute[75026]: WARNING nova.compute.manager [req-090b0636-a842-413c-84dd-72cee026df73 req-e8a4cca8-2053-422f-a20f-2c391976f3ce service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state building and task_state spawning.
Nov 10 19:58:30 user nova-compute[75026]: INFO nova.compute.manager [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Took 5.94 seconds to build instance.
Nov 10 19:58:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f333469a-23d7-4996-aa57-444166a44910 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.033s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:33 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:36 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:58:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:58:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:58:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:58:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updating instance_info_cache with network_info: [{"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:58:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:58:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:58:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:58:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:58:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIHsOiGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:58:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:58:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:58:43 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff206090-0e90-4532-95bf-97b0c7c2345a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:58:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c7121a-52ec-4d5f-a2fc-e0725056f24a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38] added
Nov 10 19:58:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[478f23e1-3cc8-4826-81e1-66b42b7b63c5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf7f88-8adb-4011-bb1e-2978d251c77f]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIHsOiGU {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIHsOiGU" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd822c7b-a2c5-40f3-ab82-a46f84fe12d6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kIHsOiGU'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b48a0-f777-42e3-819e-09115718dbc6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1384169-6827-43ca-a18a-e3d841cf99f2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:58:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:58:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:58:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:58:43 user nova-compute[75026]: 
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[803051a0-f9f2-4fd2-952e-b4960a337e24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38, portal: 172.16.0.220,3260]
Nov 10 19:58:43 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38, portal: 172.16.0.220,3260] successful.
Nov 10 19:58:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2451f22b-f33d-4a85-81f5-95a37c94c23b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0857a37-846c-4388-82e6-7f75b59332ea]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 (non-flash)
Nov 10 19:58:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:58:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 (non-flash)
Nov 10 19:58:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91670be-6093-4943-99b6-de146d31e30e]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIHsOiGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:58:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:58:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8354MB free_disk=24.996379852294922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23332393464626165', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332393464626165', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:58:45 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:58:45 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:58:45 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:58:45 user nova-compute[75026]:   <serial>0f663709-e6cd-4bd4-8310-d44156f98b38</serial>
Nov 10 19:58:45 user nova-compute[75026]: </disk>
Nov 10 19:58:45 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] No VIF found with MAC fa:16:3e:4f:c9:a3, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:58:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-62210a41-0f37-4fe9-be29-2e6b40809f16 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.775s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:58:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:58:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:58:48 user nova-compute[75026]: INFO nova.compute.manager [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Detaching volume 0f663709-e6cd-4bd4-8310-d44156f98b38
Nov 10 19:58:48 user nova-compute[75026]: INFO nova.virt.block_device [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Attempting to driver detach volume 0f663709-e6cd-4bd4-8310-d44156f98b38 from mountpoint /dev/vdb
Nov 10 19:58:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Attempting to detach device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:58:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:58:48 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:58:48 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:58:48 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:58:48 user nova-compute[75026]:   <serial>0f663709-e6cd-4bd4-8310-d44156f98b38</serial>
Nov 10 19:58:48 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:58:48 user nova-compute[75026]: </disk>
Nov 10 19:58:48 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:58:48 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully detached device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the persistent domain config.
Nov 10 19:58:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d852683-d701-472f-a089-ce5742ba3802 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:58:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:58:48 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:58:48 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:58:48 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:58:48 user nova-compute[75026]:   <serial>0f663709-e6cd-4bd4-8310-d44156f98b38</serial>
Nov 10 19:58:48 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:58:48 user nova-compute[75026]: </disk>
Nov 10 19:58:48 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:58:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:58:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:58:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:58:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:58:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:59:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:59:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:59:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:59:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d852683-d701-472f-a089-ce5742ba3802 is timed out.
Nov 10 19:59:08 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully detached device vdb from instance 3d852683-d701-472f-a089-ce5742ba3802 from the live domain config.
Nov 10 19:59:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIHsOiGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:59:08 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3e47aa-4e95-4bbd-9625-a258aee7498c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 19:59:08 user nova-compute[75026]: No targets found.
Nov 10 19:59:08 user nova-compute[75026]: iSNS:
Nov 10 19:59:08 user nova-compute[75026]: No targets found.
Nov 10 19:59:08 user nova-compute[75026]: STATIC:
Nov 10 19:59:08 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38
Nov 10 19:59:08 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 19:59:08 user nova-compute[75026]:                 Iface Name: default
Nov 10 19:59:08 user nova-compute[75026]: FIRMWARE:
Nov 10 19:59:08 user nova-compute[75026]: No targets found.
Nov 10 19:59:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 19:59:08 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 19:59:08 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca810d29-55f5-4376-97b5-2f1208f48b1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11b44d5-2ea0-4542-98a1-05ab79118678]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 (non-flash)
Nov 10 19:59:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 (non-flash)
Nov 10 19:59:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed982a6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b1c37a-bb73-460b-ba6b-da84ccb182da]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[262f21d3-bde0-4138-a63f-6efbfb39be40]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77149b13-4d5f-4dd9-87b6-1bea7cf134c8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 19:59:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c882e0fb-b21a-4fc2-9369-fe1adb5e3bbb]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[019dac81-fb77-4537-a1e3-ea5c95486aa1]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a29cb0-91e6-410e-b03d-fbe08c69904f]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38, portal: 172.16.0.220,3260]
Nov 10 19:59:09 user nova-compute[75026]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38, portal: 172.16.0.220,3260] successful.
Nov 10 19:59:09 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f663709-e6cd-4bd4-8310-d44156f98b38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[164dfaee-1f6c-4b32-9af2-913fa1f83399]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] <== disconnect_volume: return (270ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:59:09 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 19:59:10 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'flavor' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:59:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c78ab240-85e6-4798-8962-609d3a3757e2 tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:59:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:59:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:59:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:59:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:59:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:59:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 19:59:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:59:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 19:59:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-e3be655c-8003-4eb9-88aa-72d38b5cc7fb req-801c270f-f698-4240-ab22-fe3d608c3dd6 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received event network-changed-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-e3be655c-8003-4eb9-88aa-72d38b5cc7fb req-801c270f-f698-4240-ab22-fe3d608c3dd6 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Refreshing instance network info cache due to event network-changed-ae0dedd5-22e5-4316-bf0b-2b78aab9038e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e3be655c-8003-4eb9-88aa-72d38b5cc7fb req-801c270f-f698-4240-ab22-fe3d608c3dd6 service nova] Acquiring lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e3be655c-8003-4eb9-88aa-72d38b5cc7fb req-801c270f-f698-4240-ab22-fe3d608c3dd6 service nova] Acquired lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-e3be655c-8003-4eb9-88aa-72d38b5cc7fb req-801c270f-f698-4240-ab22-fe3d608c3dd6 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Refreshing network info cache for port ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-e3be655c-8003-4eb9-88aa-72d38b5cc7fb req-801c270f-f698-4240-ab22-fe3d608c3dd6 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Updated VIF entry in instance network info cache for port ae0dedd5-22e5-4316-bf0b-2b78aab9038e. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-e3be655c-8003-4eb9-88aa-72d38b5cc7fb req-801c270f-f698-4240-ab22-fe3d608c3dd6 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Updating instance_info_cache with network_info: [{"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e3be655c-8003-4eb9-88aa-72d38b5cc7fb req-801c270f-f698-4240-ab22-fe3d608c3dd6 service nova] Releasing lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'flavor' on Instance uuid 0e1cfe70-df7d-43e4-96a2-fec4758da456 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:59:19 user nova-compute[75026]: INFO nova.compute.manager [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Attaching volume ecab6fc0-0c83-430e-bda6-a2ab9c9b551f to /dev/vdb
Nov 10 19:59:19 user nova-compute[75026]: DEBUG os_brick.utils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea009b39-368d-43d1-9526-44036a12c338]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6612daf1-5dcc-4dcf-9f52-74ff9cea9945]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2967dc75-8cc9-46ab-adc8-21ff69a52be1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edd4135-e12f-40cf-9805-dd1c8a8d515e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 19:59:19 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:20 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 19:59:20 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 19:59:20 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b0fa3-e212-4dd4-bf21-e731aefbb944]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 19:59:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 19:59:20 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 19:59:20 user nova-compute[75026]: DEBUG os_brick.utils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:59:20 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Updating existing volume attachment record: a9d69b8f-b813-4b1b-8eb8-75a989cba67c {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 19:59:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:35 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 19:59:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 19:59:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 19:59:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 19:59:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 19:59:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:59:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 19:59:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 19:59:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 19:59:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:59:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:59:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:59:41 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 19:59:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scYSiCUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 19:59:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:59:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 19:59:43 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dd4b09-c898-45ee-94d2-c9371d789da3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 19:59:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3facb1-21c7-45b0-8921-ea71cf217396]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f] added
Nov 10 19:59:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b481c42-46c7-4a9b-803a-295864082a44]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac3c3ac-b868-40b4-9d51-7aac0149ab4b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scYSiCUl {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scYSiCUl" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ebc93-0b50-4a90-9c64-be13845666ab]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scYSiCUl'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[458dc750-7520-4958-8edd-46a34e436176]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7875cc2-7c98-4fad-b3f1-e7a6bfc2fe15]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:59:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 19:59:43 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:59:43 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 19:59:43 user nova-compute[75026]: 
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e3a6e-01f3-4b7e-896e-dadc98362d80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f, portal: 172.16.0.220,3260]
Nov 10 19:59:43 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f, portal: 172.16.0.220,3260] successful.
Nov 10 19:59:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b292d00-5277-4808-b12d-7d2f5ef0b511]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[51272222-e955-4cd4-8d4c-4151495af22a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f (non-flash)
Nov 10 19:59:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f (non-flash)
Nov 10 19:59:43 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[177cff77-afce-446f-8227-0574b55e6c3e]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scYSiCUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '26538393865353562', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538393865353562', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 19:59:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:59:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8340MB free_disk=24.96733856201172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'flavor' on Instance uuid 0e1cfe70-df7d-43e4-96a2-fec4758da456 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 19:59:44 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:59:44 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:59:44 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:59:44 user nova-compute[75026]:   <serial>ecab6fc0-0c83-430e-bda6-a2ab9c9b551f</serial>
Nov 10 19:59:44 user nova-compute[75026]: </disk>
Nov 10 19:59:44 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 19:59:44 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 19:59:45 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 19:59:45 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 19:59:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 19:59:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:59:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:59:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 19:59:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] No VIF found with MAC fa:16:3e:51:5e:02, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 19:59:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b7b4237b-777b-4fd1-bad0-3645f89933db tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.616s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 19:59:46 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 19:59:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 19:59:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 19:59:47 user nova-compute[75026]: INFO nova.compute.manager [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Detaching volume ecab6fc0-0c83-430e-bda6-a2ab9c9b551f
Nov 10 19:59:47 user nova-compute[75026]: INFO nova.virt.block_device [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Attempting to driver detach volume ecab6fc0-0c83-430e-bda6-a2ab9c9b551f from mountpoint /dev/vdb
Nov 10 19:59:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Attempting to detach device vdb from instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 19:59:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:59:47 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:59:47 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:59:47 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:59:47 user nova-compute[75026]:   <serial>ecab6fc0-0c83-430e-bda6-a2ab9c9b551f</serial>
Nov 10 19:59:47 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:59:47 user nova-compute[75026]: </disk>
Nov 10 19:59:47 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:59:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Successfully detached device vdb from instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 from the persistent domain config.
Nov 10 19:59:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 19:59:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 19:59:47 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 19:59:47 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 19:59:47 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 19:59:47 user nova-compute[75026]:   <serial>ecab6fc0-0c83-430e-bda6-a2ab9c9b551f</serial>
Nov 10 19:59:47 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 19:59:47 user nova-compute[75026]: </disk>
Nov 10 19:59:47 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 19:59:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 19:59:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 19:59:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 19:59:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 19:59:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:03 user nova-compute[75026]: INFO nova.compute.manager [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Unshelving
Nov 10 20:00:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'pci_requests' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'numa_topology' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 20:00:03 user nova-compute[75026]: INFO nova.compute.claims [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Claim successful on node user
Nov 10 20:00:03 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:03 user nova-compute[75026]: INFO nova.network.neutron [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating port ff283b79-3cdf-4b42-8cda-fdf4a30102c6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 20:00:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquired lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-5a98b715-b63e-45c0-99de-da1e6fb97c96 req-31daba7b-5d43-44fb-ab9a-dcbcf86f7b4e service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-changed-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG nova.compute.manager [req-5a98b715-b63e-45c0-99de-da1e6fb97c96 req-31daba7b-5d43-44fb-ab9a-dcbcf86f7b4e service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Refreshing instance network info cache due to event network-changed-ff283b79-3cdf-4b42-8cda-fdf4a30102c6. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5a98b715-b63e-45c0-99de-da1e6fb97c96 req-31daba7b-5d43-44fb-ab9a-dcbcf86f7b4e service nova] Acquiring lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG nova.network.neutron [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating instance_info_cache with network_info: [{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Releasing lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 20:00:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Creating image(s)
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'trusted_certs' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5a98b715-b63e-45c0-99de-da1e6fb97c96 req-31daba7b-5d43-44fb-ab9a-dcbcf86f7b4e service nova] Acquired lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG nova.network.neutron [req-5a98b715-b63e-45c0-99de-da1e6fb97c96 req-31daba7b-5d43-44fb-ab9a-dcbcf86f7b4e service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Refreshing network info cache for port ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG nova.objects.base [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<c73e0db5-dc93-428f-bb36-eb42103e35ef> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "42bb859ec1d867b47b1edece92f8b54baba6d6a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "42bb859ec1d867b47b1edece92f8b54baba6d6a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2.part --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG nova.virt.images [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] 49702992-b16e-4414-97a5-69b147b7cec6 was qcow2, converting to raw {{(pid=75026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG nova.privsep.utils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2.part /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2.converted {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG nova.network.neutron [req-5a98b715-b63e-45c0-99de-da1e6fb97c96 req-31daba7b-5d43-44fb-ab9a-dcbcf86f7b4e service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updated VIF entry in instance network info cache for port ff283b79-3cdf-4b42-8cda-fdf4a30102c6. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG nova.network.neutron [req-5a98b715-b63e-45c0-99de-da1e6fb97c96 req-31daba7b-5d43-44fb-ab9a-dcbcf86f7b4e service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating instance_info_cache with network_info: [{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-5a98b715-b63e-45c0-99de-da1e6fb97c96 req-31daba7b-5d43-44fb-ab9a-dcbcf86f7b4e service nova] Releasing lock "refresh_cache-c73e0db5-dc93-428f-bb36-eb42103e35ef" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2.part /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2.converted" returned: 0 in 0.570s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2.converted --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "42bb859ec1d867b47b1edece92f8b54baba6d6a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.381s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2 --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "42bb859ec1d867b47b1edece92f8b54baba6d6a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "42bb859ec1d867b47b1edece92f8b54baba6d6a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2 --force-share --output=json" returned: 0 in 0.236s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2,backing_fmt=raw /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2,backing_fmt=raw /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk 1073741824" returned: 0 in 0.056s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "42bb859ec1d867b47b1edece92f8b54baba6d6a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2 --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42bb859ec1d867b47b1edece92f8b54baba6d6a2 --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'migration_context' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:07 user nova-compute[75026]: DEBUG nova.objects.base [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<c73e0db5-dc93-428f-bb36-eb42103e35ef> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:07 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Rebasing disk image.
Nov 10 20:00:07 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 is timed out.
Nov 10 20:00:08 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Successfully detached device vdb from instance 0e1cfe70-df7d-43e4-96a2-fec4758da456 from the live domain config.
Nov 10 20:00:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scYSiCUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:00:08 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35175f4-2cf4-4350-a3dc-47678dccfb48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 20:00:08 user nova-compute[75026]: No targets found.
Nov 10 20:00:08 user nova-compute[75026]: iSNS:
Nov 10 20:00:08 user nova-compute[75026]: No targets found.
Nov 10 20:00:08 user nova-compute[75026]: STATIC:
Nov 10 20:00:08 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f
Nov 10 20:00:08 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 20:00:08 user nova-compute[75026]:                 Iface Name: default
Nov 10 20:00:08 user nova-compute[75026]: FIRMWARE:
Nov 10 20:00:08 user nova-compute[75026]: No targets found.
Nov 10 20:00:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 20:00:08 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 20:00:08 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.217s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd -F raw /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b13526d-e1ac-4bf9-b7b0-60a464f38e02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3e65b-5327-49c1-b4a8-8e4bb3faeb85]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f (non-flash)
Nov 10 20:00:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f (non-flash)
Nov 10 20:00:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed80117400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d873d7-ef81-4695-a2e3-f68319cab740]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a787389d-2ffd-44fb-b8c3-d125f57c6646]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.033s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe24fa-8f2f-4d86-a7ff-42786292237c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2984fe7-51de-425b-98bc-c2208c298394]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4201f4bd-0d1e-46a4-a167-108b005dd054]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0867b534-7b0b-4137-ab2e-cf10e5c694c0]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f, portal: 172.16.0.220,3260]
Nov 10 20:00:08 user nova-compute[75026]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f, portal: 172.16.0.220,3260] successful.
Nov 10 20:00:08 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecab6fc0-0c83-430e-bda6-a2ab9c9b551f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f3bae-14bc-47df-87ac-951164738619]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] <== disconnect_volume: return (361ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:00:08 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 20:00:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'flavor' on Instance uuid 0e1cfe70-df7d-43e4-96a2-fec4758da456 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-b1b6e198-42f8-4498-b3d7-86b0f160429b tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.325s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd -F raw /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk" returned: 0 in 2.522s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Ensure instance console log exists: /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Start _get_guest_xml network_info=[{"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e6f8d2b88a6f8ff158eddd6d52a2b715',container_format='bare',created_at=2023-11-10T19:58:10Z,direct_url=<?>,disk_format='qcow2',id=49702992-b16e-4414-97a5-69b147b7cec6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1392156464-shelved',owner='8508550b77e9441e939a122e28f723e5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T19:58:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 20:00:10 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:00:10 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e6f8d2b88a6f8ff158eddd6d52a2b715',container_format='bare',created_at=2023-11-10T19:58:10Z,direct_url=<?>,disk_format='qcow2',id=49702992-b16e-4414-97a5-69b147b7cec6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1392156464-shelved',owner='8508550b77e9441e939a122e28f723e5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T19:58:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'vcpu_model' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.objects.base [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<c73e0db5-dc93-428f-bb36-eb42103e35ef> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1392156464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1392156464',id=47,image_ref='49702992-b16e-4414-97a5-69b147b7cec6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1626589778',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-34qz5faz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member',shelved_at='2023-11-10T19:58:14.309604',shelved_host='user',shelved_image_id='49702992-b16e-4414-97a5-69b147b7cec6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T20:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=c73e0db5-dc93-428f-bb36-eb42103e35ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'pci_devices' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.objects.base [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Object Instance<c73e0db5-dc93-428f-bb36-eb42103e35ef> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] End _get_guest_xml xml=<domain type="kvm">
Nov 10 20:00:10 user nova-compute[75026]:   <uuid>c73e0db5-dc93-428f-bb36-eb42103e35ef</uuid>
Nov 10 20:00:10 user nova-compute[75026]:   <name>instance-0000002f</name>
Nov 10 20:00:10 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 20:00:10 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 20:00:10 user nova-compute[75026]:   <metadata>
Nov 10 20:00:10 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 20:00:10 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 20:00:10 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1392156464</nova:name>
Nov 10 20:00:10 user nova-compute[75026]:       <nova:creationTime>2023-11-10 20:00:10</nova:creationTime>
Nov 10 20:00:10 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 20:00:10 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 20:00:10 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 20:00:10 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 20:00:10 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 20:00:10 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 20:00:10 user nova-compute[75026]:       </nova:flavor>
Nov 10 20:00:10 user nova-compute[75026]:       <nova:owner>
Nov 10 20:00:10 user nova-compute[75026]:         <nova:user uuid="0dd9bbcdce294a33b2692816caee276c">tempest-AttachVolumeShelveTestJSON-2009638513-project-member</nova:user>
Nov 10 20:00:10 user nova-compute[75026]:         <nova:project uuid="8508550b77e9441e939a122e28f723e5">tempest-AttachVolumeShelveTestJSON-2009638513</nova:project>
Nov 10 20:00:10 user nova-compute[75026]:       </nova:owner>
Nov 10 20:00:10 user nova-compute[75026]:       <nova:root type="image" uuid="49702992-b16e-4414-97a5-69b147b7cec6"/>
Nov 10 20:00:10 user nova-compute[75026]:       <nova:ports>
Nov 10 20:00:10 user nova-compute[75026]:         <nova:port uuid="ff283b79-3cdf-4b42-8cda-fdf4a30102c6">
Nov 10 20:00:10 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 20:00:10 user nova-compute[75026]:         </nova:port>
Nov 10 20:00:10 user nova-compute[75026]:       </nova:ports>
Nov 10 20:00:10 user nova-compute[75026]:     </nova:instance>
Nov 10 20:00:10 user nova-compute[75026]:   </metadata>
Nov 10 20:00:10 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 20:00:10 user nova-compute[75026]:     <system>
Nov 10 20:00:10 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 20:00:10 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 20:00:10 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 20:00:10 user nova-compute[75026]:       <entry name="serial">c73e0db5-dc93-428f-bb36-eb42103e35ef</entry>
Nov 10 20:00:10 user nova-compute[75026]:       <entry name="uuid">c73e0db5-dc93-428f-bb36-eb42103e35ef</entry>
Nov 10 20:00:10 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 20:00:10 user nova-compute[75026]:     </system>
Nov 10 20:00:10 user nova-compute[75026]:   </sysinfo>
Nov 10 20:00:10 user nova-compute[75026]:   <os>
Nov 10 20:00:10 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 20:00:10 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 20:00:10 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 20:00:10 user nova-compute[75026]:   </os>
Nov 10 20:00:10 user nova-compute[75026]:   <features>
Nov 10 20:00:10 user nova-compute[75026]:     <acpi/>
Nov 10 20:00:10 user nova-compute[75026]:     <apic/>
Nov 10 20:00:10 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 20:00:10 user nova-compute[75026]:   </features>
Nov 10 20:00:10 user nova-compute[75026]:   <clock offset="utc">
Nov 10 20:00:10 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 20:00:10 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 20:00:10 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 20:00:10 user nova-compute[75026]:   </clock>
Nov 10 20:00:10 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 20:00:10 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 20:00:10 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 20:00:10 user nova-compute[75026]:   </cpu>
Nov 10 20:00:10 user nova-compute[75026]:   <devices>
Nov 10 20:00:10 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 20:00:10 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 20:00:10 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk"/>
Nov 10 20:00:10 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 20:00:10 user nova-compute[75026]:     </disk>
Nov 10 20:00:10 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 20:00:10 user nova-compute[75026]:       <mac address="fa:16:3e:d1:62:45"/>
Nov 10 20:00:10 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:00:10 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 20:00:10 user nova-compute[75026]:       <target dev="tapff283b79-3c"/>
Nov 10 20:00:10 user nova-compute[75026]:     </interface>
Nov 10 20:00:10 user nova-compute[75026]:     <serial type="pty">
Nov 10 20:00:10 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/console.log" append="off"/>
Nov 10 20:00:10 user nova-compute[75026]:     </serial>
Nov 10 20:00:10 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 20:00:10 user nova-compute[75026]:     <video>
Nov 10 20:00:10 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:00:10 user nova-compute[75026]:     </video>
Nov 10 20:00:10 user nova-compute[75026]:     <rng model="virtio">
Nov 10 20:00:10 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 20:00:10 user nova-compute[75026]:     </rng>
Nov 10 20:00:10 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 20:00:10 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 20:00:10 user nova-compute[75026]:       <stats period="10"/>
Nov 10 20:00:10 user nova-compute[75026]:     </memballoon>
Nov 10 20:00:10 user nova-compute[75026]:   </devices>
Nov 10 20:00:10 user nova-compute[75026]: </domain>
Nov 10 20:00:10 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1392156464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1392156464',id=47,image_ref='49702992-b16e-4414-97a5-69b147b7cec6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1626589778',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-34qz5faz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member',shelved_at='2023-11-10T19:58:14.309604',shelved_host='user',shelved_image_id='49702992-b16e-4414-97a5-69b147b7cec6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T20:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=c73e0db5-dc93-428f-bb36-eb42103e35ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG os_vif [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57da57ed-e67e-5fd5-a57d-26d2775a69f1', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff283b79-3c, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff283b79-3c, col_values=(('qos', UUID('2c3c9f95-cc67-4e7c-92d3-8207ab53e206')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff283b79-3c, col_values=(('external_ids', {'iface-id': 'ff283b79-3cdf-4b42-8cda-fdf4a30102c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:62:45', 'vm-uuid': 'c73e0db5-dc93-428f-bb36-eb42103e35ef'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:10 user nova-compute[75026]: INFO os_vif [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c')
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:00:10 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] No VIF found with MAC fa:16:3e:d1:62:45, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-f79168a3-31ab-4367-846b-2907143ca86f req-963a0ad2-3bb9-4f85-abd2-4bff09b4246c service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f79168a3-31ab-4367-846b-2907143ca86f req-963a0ad2-3bb9-4f85-abd2-4bff09b4246c service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f79168a3-31ab-4367-846b-2907143ca86f req-963a0ad2-3bb9-4f85-abd2-4bff09b4246c service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f79168a3-31ab-4367-846b-2907143ca86f req-963a0ad2-3bb9-4f85-abd2-4bff09b4246c service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG nova.compute.manager [req-f79168a3-31ab-4367-846b-2907143ca86f req-963a0ad2-3bb9-4f85-abd2-4bff09b4246c service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:00:12 user nova-compute[75026]: WARNING nova.compute.manager [req-f79168a3-31ab-4367-846b-2907143ca86f req-963a0ad2-3bb9-4f85-abd2-4bff09b4246c service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 20:00:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 20:00:14 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 20:00:14 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance spawned successfully.
Nov 10 20:00:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca0cac55-aafa-4361-81fc-0e77398e399f req-c44cdfad-f86a-4589-a0e5-a207105f7d3b service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca0cac55-aafa-4361-81fc-0e77398e399f req-c44cdfad-f86a-4589-a0e5-a207105f7d3b service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca0cac55-aafa-4361-81fc-0e77398e399f req-c44cdfad-f86a-4589-a0e5-a207105f7d3b service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-ca0cac55-aafa-4361-81fc-0e77398e399f req-c44cdfad-f86a-4589-a0e5-a207105f7d3b service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:14 user nova-compute[75026]: DEBUG nova.compute.manager [req-ca0cac55-aafa-4361-81fc-0e77398e399f req-c44cdfad-f86a-4589-a0e5-a207105f7d3b service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:00:14 user nova-compute[75026]: WARNING nova.compute.manager [req-ca0cac55-aafa-4361-81fc-0e77398e399f req-c44cdfad-f86a-4589-a0e5-a207105f7d3b service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 20:00:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:00:14 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4ee5cc76-64bf-408e-81a6-a2b306753e66 tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.779s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-84f1ffae-fc00-479a-a977-92cc4734b1bd req-3e2a7a2f-e731-4530-a100-bc91278c3736 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-changed-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG nova.compute.manager [req-84f1ffae-fc00-479a-a977-92cc4734b1bd req-3e2a7a2f-e731-4530-a100-bc91278c3736 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Refreshing instance network info cache due to event network-changed-b924fdef-09ba-41ab-b72c-757a4ed14a64. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-84f1ffae-fc00-479a-a977-92cc4734b1bd req-3e2a7a2f-e731-4530-a100-bc91278c3736 service nova] Acquiring lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-84f1ffae-fc00-479a-a977-92cc4734b1bd req-3e2a7a2f-e731-4530-a100-bc91278c3736 service nova] Acquired lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-84f1ffae-fc00-479a-a977-92cc4734b1bd req-3e2a7a2f-e731-4530-a100-bc91278c3736 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Refreshing network info cache for port b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG nova.objects.instance [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'flavor' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:15 user nova-compute[75026]: INFO nova.compute.manager [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Attaching volume 124a0bfd-cf9a-499a-85c7-20678d974081 to /dev/vdb
Nov 10 20:00:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-84f1ffae-fc00-479a-a977-92cc4734b1bd req-3e2a7a2f-e731-4530-a100-bc91278c3736 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updated VIF entry in instance network info cache for port b924fdef-09ba-41ab-b72c-757a4ed14a64. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG nova.network.neutron [req-84f1ffae-fc00-479a-a977-92cc4734b1bd req-3e2a7a2f-e731-4530-a100-bc91278c3736 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-84f1ffae-fc00-479a-a977-92cc4734b1bd req-3e2a7a2f-e731-4530-a100-bc91278c3736 service nova] Releasing lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG os_brick.utils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9114d1-23b3-4c3b-b1e0-27605e1a842b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d098f3-4659-4392-b536-cbe82bf77472]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:15 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f1ab54-ef18-459b-8c32-b54bf6842634]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a881bec-5336-4960-8d4f-2402be441f55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 20:00:16 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 20:00:16 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[49db4903-6408-4225-9eb3-80880c8c9485]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG os_brick.utils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:00:16 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating existing volume attachment record: ad917423-30e8-4596-9769-be75a60af258 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 20:00:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:37 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f606201-f0c6-4260-a8e2-69ea92b71bfe req-1670b7e2-4558-4868-abe4-25a993c08658 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received event network-changed-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-8f606201-f0c6-4260-a8e2-69ea92b71bfe req-1670b7e2-4558-4868-abe4-25a993c08658 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Refreshing instance network info cache due to event network-changed-ae0dedd5-22e5-4316-bf0b-2b78aab9038e. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f606201-f0c6-4260-a8e2-69ea92b71bfe req-1670b7e2-4558-4868-abe4-25a993c08658 service nova] Acquiring lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f606201-f0c6-4260-a8e2-69ea92b71bfe req-1670b7e2-4558-4868-abe4-25a993c08658 service nova] Acquired lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-8f606201-f0c6-4260-a8e2-69ea92b71bfe req-1670b7e2-4558-4868-abe4-25a993c08658 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Refreshing network info cache for port ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:38 user nova-compute[75026]: INFO nova.compute.manager [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Terminating instance
Nov 10 20:00:38 user nova-compute[75026]: DEBUG nova.compute.manager [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-8f606201-f0c6-4260-a8e2-69ea92b71bfe req-1670b7e2-4558-4868-abe4-25a993c08658 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Updated VIF entry in instance network info cache for port ae0dedd5-22e5-4316-bf0b-2b78aab9038e. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG nova.network.neutron [req-8f606201-f0c6-4260-a8e2-69ea92b71bfe req-1670b7e2-4558-4868-abe4-25a993c08658 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Updating instance_info_cache with network_info: [{"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:00:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8f606201-f0c6-4260-a8e2-69ea92b71bfe req-1670b7e2-4558-4868-abe4-25a993c08658 service nova] Releasing lock "refresh_cache-0e1cfe70-df7d-43e4-96a2-fec4758da456" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:00:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Instance destroyed successfully.
Nov 10 20:00:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'resources' on Instance uuid 0e1cfe70-df7d-43e4-96a2-fec4758da456 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1817997594',display_name='tempest-TestStampPattern-server-1817997594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1817997594',id=48,image_ref='7c064d56-61d6-4d7f-bf34-f65b27824f9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgQJf+K5q9482jlgZcnbGU3mPdTxCa9QVlp+GK538Zi4nk447tX7z9aDvYXqC82MKGVm4iUZjP/MyQSczaZobWktrkPQfNgE3pr8E4SSuPbR+IHKrONBgSCKyqrJOCD3w==',key_name='tempest-TestStampPattern-3594168',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:57:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7586dc2316c4a26b8a23491f430d07e',ramdisk_id='',reservation_id='r-6s26mt87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5b89c7bd-bb17-4b9d-a4b2-02cc5af21666',image_min_disk='1',image_min_ram='0',image_owner_id='d7586dc2316c4a26b8a23491f430d07e',image_owner_project_name='tempest-TestStampPattern-60453673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-60453673-project-member',image_user_id='bd6c5920b28543ab859267ec7278b317',owner_project_name='tempest-TestStampPattern-60453673',owner_user_name='tempest-TestStampPattern-60453673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:57:35Z,user_data=None,user_id='bd6c5920b28543ab859267ec7278b317',uuid=0e1cfe70-df7d-43e4-96a2-fec4758da456,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converting VIF {"id": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "address": "fa:16:3e:51:5e:02", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0dedd5-22", "ovs_interfaceid": "ae0dedd5-22e5-4316-bf0b-2b78aab9038e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:5e:02,bridge_name='br-int',has_traffic_filtering=True,id=ae0dedd5-22e5-4316-bf0b-2b78aab9038e,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0dedd5-22') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG os_vif [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:5e:02,bridge_name='br-int',has_traffic_filtering=True,id=ae0dedd5-22e5-4316-bf0b-2b78aab9038e,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0dedd5-22') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae0dedd5-22, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=364473a4-d3e2-4da8-8777-698d24227f7f) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:00:39 user nova-compute[75026]: INFO os_vif [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:5e:02,bridge_name='br-int',has_traffic_filtering=True,id=ae0dedd5-22e5-4316-bf0b-2b78aab9038e,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0dedd5-22')
Nov 10 20:00:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Deleting instance files /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456_del
Nov 10 20:00:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Deletion of /opt/stack/data/nova/instances/0e1cfe70-df7d-43e4-96a2-fec4758da456_del complete
Nov 10 20:00:39 user nova-compute[75026]: INFO nova.compute.manager [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 20:00:39 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:00:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:00:40 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Took 0.77 seconds to deallocate network for instance.
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-aeee35a2-649b-4f78-a0a3-5842c976dc18 req-075732eb-47fc-4ab1-b349-a513ff556d06 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received event network-vif-deleted-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received event network-vif-unplugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] No waiting events found dispatching network-vif-unplugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:00:40 user nova-compute[75026]: WARNING nova.compute.manager [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received unexpected event network-vif-unplugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e for instance with vm_state deleted and task_state None.
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received event network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] Acquiring lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.compute.manager [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] No waiting events found dispatching network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:00:40 user nova-compute[75026]: WARNING nova.compute.manager [req-3373623b-636a-4f1f-9058-c40564051f8b req-abfc2a32-5ee5-4e4e-9f37-110a73347518 service nova] [instance: 0e1cfe70-df7d-43e4-96a2-fec4758da456] Received unexpected event network-vif-plugged-ae0dedd5-22e5-4316-bf0b-2b78aab9038e for instance with vm_state deleted and task_state None.
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updating instance_info_cache with network_info: [{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:40 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Deleted allocations for instance 0e1cfe70-df7d-43e4-96a2-fec4758da456
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-f68829b0-aa8a-46d5-b35f-94cf4f1653cb tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "0e1cfe70-df7d-43e4-96a2-fec4758da456" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.495s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDHTcnJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:00:41 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:00:41 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:00:41 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e8580-3dc6-4834-966c-53038a94614b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 20:00:41 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[012ab2e7-4f96-42d3-a874-0fe1f10c7d45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081] added
Nov 10 20:00:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ab9222-3d7d-4bed-9644-ba3bf74a4a97]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3572a332-010f-4db7-a5c0-42c6ba2c6366]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDHTcnJV {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NDHTcnJV" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4f2ce9-16d1-43e7-b2bd-72dac4cdce75]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NDHTcnJV'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e304e4c9-c3d0-45a0-b574-6e9c7abda691]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bbc5ad-3a9c-4937-9827-371a44c35855]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 20:00:41 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 20:00:41 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:00:41 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 20:00:41 user nova-compute[75026]: 
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b0a090-5c4d-47ea-a03d-4c2b7231acac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081, portal: 172.16.0.220,3260]
Nov 10 20:00:41 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081, portal: 172.16.0.220,3260] successful.
Nov 10 20:00:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41e1b82-b6b4-4db8-816e-14bb873104ec]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[92852126-31d4-47c3-810c-a4e5945853d9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 (non-flash)
Nov 10 20:00:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 (non-flash)
Nov 10 20:00:41 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[287d7bf7-cc38-4024-abee-9ed59ea6a552]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 20:00:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDHTcnJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26630326231383034', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630326231383034', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG nova.objects.instance [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'flavor' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 20:00:42 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:00:42 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:00:42 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:00:42 user nova-compute[75026]:   <serial>124a0bfd-cf9a-499a-85c7-20678d974081</serial>
Nov 10 20:00:42 user nova-compute[75026]: </disk>
Nov 10 20:00:42 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:42 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No VIF found with MAC fa:16:3e:98:ca:6a, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e90a839b-bea3-45a9-8324-806b703bc20c tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.389s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:44 user nova-compute[75026]: INFO nova.compute.manager [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Rescuing
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquired lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Releasing lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-e280ef7a-d1bf-4453-a262-3fd3bca7c8cc req-0fbf2b05-5cd1-443c-afaa-751c0c1847c2 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e280ef7a-d1bf-4453-a262-3fd3bca7c8cc req-0fbf2b05-5cd1-443c-afaa-751c0c1847c2 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e280ef7a-d1bf-4453-a262-3fd3bca7c8cc req-0fbf2b05-5cd1-443c-afaa-751c0c1847c2 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e280ef7a-d1bf-4453-a262-3fd3bca7c8cc req-0fbf2b05-5cd1-443c-afaa-751c0c1847c2 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.compute.manager [req-e280ef7a-d1bf-4453-a262-3fd3bca7c8cc req-0fbf2b05-5cd1-443c-afaa-751c0c1847c2 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:00:45 user nova-compute[75026]: WARNING nova.compute.manager [req-e280ef7a-d1bf-4453-a262-3fd3bca7c8cc req-0fbf2b05-5cd1-443c-afaa-751c0c1847c2 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state active and task_state rescuing.
Nov 10 20:00:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance destroyed successfully.
Nov 10 20:00:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Attempting rescue
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance directory exists: not creating {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 20:00:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Creating image(s)
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.rescue {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.rescue" returned: 0 in 0.054s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'migration_context' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.objects.base [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<15886f5c-4c07-4506-8f6d-fc9124ed2fe6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Start _get_guest_xml network_info=[{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:98:ca:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'resources' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.objects.base [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<15886f5c-4c07-4506-8f6d-fc9124ed2fe6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'numa_topology' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.objects.base [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<15886f5c-4c07-4506-8f6d-fc9124ed2fe6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:00:45 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:00:45 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 20:00:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.objects.base [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<15886f5c-4c07-4506-8f6d-fc9124ed2fe6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-943681264',display_name='tempest-ServerRescueNegativeTestJSON-server-943681264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-943681264',id=49,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYMM+R8cnyQrOlyL+/tho6trX/akyP2QOOF40b/FXBOeSXJW/q3xViduU9BybQAJists388l16o9gc6iO7kloKaRU/YalCEiIYQMmAfPzTAwtnsIgv5K1hLgEsyz8XftQ==',key_name='tempest-keypair-1041471018',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-jve2rikm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T19:58:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=15886f5c-4c07-4506-8f6d-fc9124ed2fe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:98:ca:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "vif_mac": "fa:16:3e:98:ca:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=b924fdef-09ba-41ab-b72c-757a4ed14a64,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924fdef-09') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'pci_devices' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:00:46 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:00:46 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8283MB free_disk=24.94097900390625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.objects.base [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Object Instance<15886f5c-4c07-4506-8f6d-fc9124ed2fe6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 20:00:46 user nova-compute[75026]:   <uuid>15886f5c-4c07-4506-8f6d-fc9124ed2fe6</uuid>
Nov 10 20:00:46 user nova-compute[75026]:   <name>instance-00000031</name>
Nov 10 20:00:46 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 20:00:46 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 20:00:46 user nova-compute[75026]:   <metadata>
Nov 10 20:00:46 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 20:00:46 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 20:00:46 user nova-compute[75026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-943681264</nova:name>
Nov 10 20:00:46 user nova-compute[75026]:       <nova:creationTime>2023-11-10 20:00:45</nova:creationTime>
Nov 10 20:00:46 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 20:00:46 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 20:00:46 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 20:00:46 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 20:00:46 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 20:00:46 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 20:00:46 user nova-compute[75026]:       </nova:flavor>
Nov 10 20:00:46 user nova-compute[75026]:       <nova:owner>
Nov 10 20:00:46 user nova-compute[75026]:         <nova:user uuid="b7ef73abaece4f08b00d81d403a8a66a">tempest-ServerRescueNegativeTestJSON-1130240525-project-member</nova:user>
Nov 10 20:00:46 user nova-compute[75026]:         <nova:project uuid="64d8f446a3094348839f9216faff0485">tempest-ServerRescueNegativeTestJSON-1130240525</nova:project>
Nov 10 20:00:46 user nova-compute[75026]:       </nova:owner>
Nov 10 20:00:46 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 20:00:46 user nova-compute[75026]:       <nova:ports>
Nov 10 20:00:46 user nova-compute[75026]:         <nova:port uuid="b924fdef-09ba-41ab-b72c-757a4ed14a64">
Nov 10 20:00:46 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 20:00:46 user nova-compute[75026]:         </nova:port>
Nov 10 20:00:46 user nova-compute[75026]:       </nova:ports>
Nov 10 20:00:46 user nova-compute[75026]:     </nova:instance>
Nov 10 20:00:46 user nova-compute[75026]:   </metadata>
Nov 10 20:00:46 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 20:00:46 user nova-compute[75026]:     <system>
Nov 10 20:00:46 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 20:00:46 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 20:00:46 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 20:00:46 user nova-compute[75026]:       <entry name="serial">15886f5c-4c07-4506-8f6d-fc9124ed2fe6</entry>
Nov 10 20:00:46 user nova-compute[75026]:       <entry name="uuid">15886f5c-4c07-4506-8f6d-fc9124ed2fe6</entry>
Nov 10 20:00:46 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 20:00:46 user nova-compute[75026]:     </system>
Nov 10 20:00:46 user nova-compute[75026]:   </sysinfo>
Nov 10 20:00:46 user nova-compute[75026]:   <os>
Nov 10 20:00:46 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 20:00:46 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 20:00:46 user nova-compute[75026]:   </os>
Nov 10 20:00:46 user nova-compute[75026]:   <features>
Nov 10 20:00:46 user nova-compute[75026]:     <acpi/>
Nov 10 20:00:46 user nova-compute[75026]:     <apic/>
Nov 10 20:00:46 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 20:00:46 user nova-compute[75026]:   </features>
Nov 10 20:00:46 user nova-compute[75026]:   <clock offset="utc">
Nov 10 20:00:46 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 20:00:46 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 20:00:46 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 20:00:46 user nova-compute[75026]:   </clock>
Nov 10 20:00:46 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 20:00:46 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 20:00:46 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 20:00:46 user nova-compute[75026]:   </cpu>
Nov 10 20:00:46 user nova-compute[75026]:   <devices>
Nov 10 20:00:46 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 20:00:46 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 20:00:46 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.rescue"/>
Nov 10 20:00:46 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 20:00:46 user nova-compute[75026]:     </disk>
Nov 10 20:00:46 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 20:00:46 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 20:00:46 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk"/>
Nov 10 20:00:46 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 20:00:46 user nova-compute[75026]:     </disk>
Nov 10 20:00:46 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 20:00:46 user nova-compute[75026]:       <mac address="fa:16:3e:98:ca:6a"/>
Nov 10 20:00:46 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:00:46 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 20:00:46 user nova-compute[75026]:       <target dev="tapb924fdef-09"/>
Nov 10 20:00:46 user nova-compute[75026]:     </interface>
Nov 10 20:00:46 user nova-compute[75026]:     <serial type="pty">
Nov 10 20:00:46 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/console.log" append="off"/>
Nov 10 20:00:46 user nova-compute[75026]:     </serial>
Nov 10 20:00:46 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 20:00:46 user nova-compute[75026]:     <video>
Nov 10 20:00:46 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:00:46 user nova-compute[75026]:     </video>
Nov 10 20:00:46 user nova-compute[75026]:     <rng model="virtio">
Nov 10 20:00:46 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 20:00:46 user nova-compute[75026]:     </rng>
Nov 10 20:00:46 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 20:00:46 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 20:00:46 user nova-compute[75026]:       <stats period="10"/>
Nov 10 20:00:46 user nova-compute[75026]:     </memballoon>
Nov 10 20:00:46 user nova-compute[75026]:   </devices>
Nov 10 20:00:46 user nova-compute[75026]: </domain>
Nov 10 20:00:46 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 20:00:46 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance destroyed successfully.
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] No VIF found with MAC fa:16:3e:98:ca:6a, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 3d852683-d701-472f-a089-ce5742ba3802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c73e0db5-dc93-428f-bb36-eb42103e35ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:00:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-03ede0c6-2c7c-4263-926f-9a0cccc58de0 req-dddbaf02-9f39-4e94-a605-badadae3fdc5 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-03ede0c6-2c7c-4263-926f-9a0cccc58de0 req-dddbaf02-9f39-4e94-a605-badadae3fdc5 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-03ede0c6-2c7c-4263-926f-9a0cccc58de0 req-dddbaf02-9f39-4e94-a605-badadae3fdc5 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-03ede0c6-2c7c-4263-926f-9a0cccc58de0 req-dddbaf02-9f39-4e94-a605-badadae3fdc5 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-03ede0c6-2c7c-4263-926f-9a0cccc58de0 req-dddbaf02-9f39-4e94-a605-badadae3fdc5 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:00:47 user nova-compute[75026]: WARNING nova.compute.manager [req-03ede0c6-2c7c-4263-926f-9a0cccc58de0 req-dddbaf02-9f39-4e94-a605-badadae3fdc5 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state active and task_state rescuing.
Nov 10 20:00:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:00:49 user nova-compute[75026]: WARNING nova.compute.manager [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state active and task_state rescuing.
Nov 10 20:00:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:00:49 user nova-compute[75026]: WARNING nova.compute.manager [req-876fa560-7c48-4381-bbc1-95962a4e67c3 req-d98b407d-96b4-4ea5-98cd-d27160842fd7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state active and task_state rescuing.
Nov 10 20:00:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fc8d5499-47ad-4a6a-807f-bfd93ac1c788 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:00:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:00:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:00:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:00:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:03 user nova-compute[75026]: INFO nova.compute.manager [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Terminating instance
Nov 10 20:01:03 user nova-compute[75026]: DEBUG nova.compute.manager [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-6f29e09a-5f6c-40d1-b124-f1b6d94917c6 req-7ce4b61a-6abd-4ca8-921a-63b7c1446a4a service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-unplugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6f29e09a-5f6c-40d1-b124-f1b6d94917c6 req-7ce4b61a-6abd-4ca8-921a-63b7c1446a4a service nova] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6f29e09a-5f6c-40d1-b124-f1b6d94917c6 req-7ce4b61a-6abd-4ca8-921a-63b7c1446a4a service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6f29e09a-5f6c-40d1-b124-f1b6d94917c6 req-7ce4b61a-6abd-4ca8-921a-63b7c1446a4a service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-6f29e09a-5f6c-40d1-b124-f1b6d94917c6 req-7ce4b61a-6abd-4ca8-921a-63b7c1446a4a service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] No waiting events found dispatching network-vif-unplugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:03 user nova-compute[75026]: DEBUG nova.compute.manager [req-6f29e09a-5f6c-40d1-b124-f1b6d94917c6 req-7ce4b61a-6abd-4ca8-921a-63b7c1446a4a service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-unplugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Instance destroyed successfully.
Nov 10 20:01:04 user nova-compute[75026]: DEBUG nova.objects.instance [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lazy-loading 'resources' on Instance uuid 3d852683-d701-472f-a089-ce5742ba3802 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1902786107',display_name='tempest-SnapshotDataIntegrityTests-server-1902786107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1902786107',id=45,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjViPZduKPaCSfWEG1ufsuZ7oziTvICQJWe3MmE5r3/LyYoGlIgKfWw4QdS4276YosEhq+8EGOKejtQQlBxQ9xrsNq3l4U9tSxLbEd1K+Qc/ZbFrhgA8fIE6Mf+4vM9xQ==',key_name='tempest-keypair-569837065',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:51:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43d70df1f04741f8bb54ea94e932783a',ramdisk_id='',reservation_id='r-hqi4tf9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1335929358',owner_user_name='tempest-SnapshotDataIntegrityTests-1335929358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='266d44e9c0204bbba57e1148892645e2',uuid=3d852683-d701-472f-a089-ce5742ba3802,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Converting VIF {"id": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "address": "fa:16:3e:4f:c9:a3", "network": {"id": "21fb66d1-18c5-48a4-8302-9cc47276a42a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-468917273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d70df1f04741f8bb54ea94e932783a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cad14c8-45", "ovs_interfaceid": "7cad14c8-45e1-428b-9e60-1416eb8c3574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c9:a3,bridge_name='br-int',has_traffic_filtering=True,id=7cad14c8-45e1-428b-9e60-1416eb8c3574,network=Network(21fb66d1-18c5-48a4-8302-9cc47276a42a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cad14c8-45') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG os_vif [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c9:a3,bridge_name='br-int',has_traffic_filtering=True,id=7cad14c8-45e1-428b-9e60-1416eb8c3574,network=Network(21fb66d1-18c5-48a4-8302-9cc47276a42a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cad14c8-45') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cad14c8-45, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b7474bc-11eb-43ba-9e1e-0011797f57c8) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:04 user nova-compute[75026]: INFO os_vif [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c9:a3,bridge_name='br-int',has_traffic_filtering=True,id=7cad14c8-45e1-428b-9e60-1416eb8c3574,network=Network(21fb66d1-18c5-48a4-8302-9cc47276a42a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cad14c8-45')
Nov 10 20:01:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Deleting instance files /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802_del
Nov 10 20:01:04 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Deletion of /opt/stack/data/nova/instances/3d852683-d701-472f-a089-ce5742ba3802_del complete
Nov 10 20:01:04 user nova-compute[75026]: INFO nova.compute.manager [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 10 20:01:04 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 3d852683-d701-472f-a089-ce5742ba3802] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:01:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-389f2ad3-8f47-4df8-ae26-2d7abc602c57 req-75797330-07cc-42b4-89c4-e0bb8a24e7ef service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-deleted-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:05 user nova-compute[75026]: INFO nova.compute.manager [req-389f2ad3-8f47-4df8-ae26-2d7abc602c57 req-75797330-07cc-42b4-89c4-e0bb8a24e7ef service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Neutron deleted interface 7cad14c8-45e1-428b-9e60-1416eb8c3574; detaching it from the instance and deleting it from the info cache
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.network.neutron [req-389f2ad3-8f47-4df8-ae26-2d7abc602c57 req-75797330-07cc-42b4-89c4-e0bb8a24e7ef service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:01:05 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Took 0.91 seconds to deallocate network for instance.
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-389f2ad3-8f47-4df8-ae26-2d7abc602c57 req-75797330-07cc-42b4-89c4-e0bb8a24e7ef service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Detach interface failed, port_id=7cad14c8-45e1-428b-9e60-1416eb8c3574, reason: Instance 3d852683-d701-472f-a089-ce5742ba3802 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:05 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Deleted allocations for instance 3d852683-d701-472f-a089-ce5742ba3802
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] No waiting events found dispatching network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:05 user nova-compute[75026]: WARNING nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received unexpected event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 for instance with vm_state deleted and task_state None.
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] No waiting events found dispatching network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:05 user nova-compute[75026]: WARNING nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received unexpected event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 for instance with vm_state deleted and task_state None.
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] No waiting events found dispatching network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:05 user nova-compute[75026]: WARNING nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received unexpected event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 for instance with vm_state deleted and task_state None.
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-unplugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] No waiting events found dispatching network-vif-unplugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:05 user nova-compute[75026]: WARNING nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received unexpected event network-vif-unplugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 for instance with vm_state deleted and task_state None.
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Acquiring lock "3d852683-d701-472f-a089-ce5742ba3802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] Lock "3d852683-d701-472f-a089-ce5742ba3802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:05 user nova-compute[75026]: DEBUG nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] No waiting events found dispatching network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:05 user nova-compute[75026]: WARNING nova.compute.manager [req-f36acde6-c6cb-4c1a-a618-cf6c5c47d88c req-075ac114-c59a-4cdc-a0e1-0d8876aba8ae service nova] [instance: 3d852683-d701-472f-a089-ce5742ba3802] Received unexpected event network-vif-plugged-7cad14c8-45e1-428b-9e60-1416eb8c3574 for instance with vm_state deleted and task_state None.
Nov 10 20:01:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-6bbcff6e-d706-4da4-b0fd-12eeee09ed3b tempest-SnapshotDataIntegrityTests-1335929358 tempest-SnapshotDataIntegrityTests-1335929358-project-member] Lock "3d852683-d701-472f-a089-ce5742ba3802" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.382s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:01:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:01:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:01:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:01:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:01:40 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updating instance_info_cache with network_info: [{"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:01:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:01:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:01:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:01:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:01:46 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:01:46 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8370MB free_disk=25.056591033935547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance c73e0db5-dc93-428f-bb36-eb42103e35ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:01:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:01:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:01:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:01:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:49 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:01:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:53 user nova-compute[75026]: INFO nova.compute.manager [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Terminating instance
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-196be7e2-bf49-4433-940b-8d063ed63606 req-b38b836f-9663-4bda-a0d0-fb4031f483d2 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-196be7e2-bf49-4433-940b-8d063ed63606 req-b38b836f-9663-4bda-a0d0-fb4031f483d2 service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-196be7e2-bf49-4433-940b-8d063ed63606 req-b38b836f-9663-4bda-a0d0-fb4031f483d2 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-196be7e2-bf49-4433-940b-8d063ed63606 req-b38b836f-9663-4bda-a0d0-fb4031f483d2 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-196be7e2-bf49-4433-940b-8d063ed63606 req-b38b836f-9663-4bda-a0d0-fb4031f483d2 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-196be7e2-bf49-4433-940b-8d063ed63606 req-b38b836f-9663-4bda-a0d0-fb4031f483d2 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-unplugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 20:01:53 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Instance destroyed successfully.
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.objects.instance [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lazy-loading 'resources' on Instance uuid c73e0db5-dc93-428f-bb36-eb42103e35ef {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T19:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1392156464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1392156464',id=47,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt1SMKNVbZrZWCG0xgTQygNymmKeSU4Aj6mxH4Q/QYsYpPf9JJt+AVy9UYfFTJyftOU7x5GA2nwK7BDxaM/LbBcUQ6EHUl+V9IRJC79d31XyLm9XRHTunobb7mIr5Xj6g==',key_name='tempest-keypair-1626589778',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8508550b77e9441e939a122e28f723e5',ramdisk_id='',reservation_id='r-34qz5faz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2009638513',owner_user_name='tempest-AttachVolumeShelveTestJSON-2009638513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T20:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0dd9bbcdce294a33b2692816caee276c',uuid=c73e0db5-dc93-428f-bb36-eb42103e35ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converting VIF {"id": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "address": "fa:16:3e:d1:62:45", "network": {"id": "c165f418-f237-4588-bbb3-bf971687a8a7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-225713136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8508550b77e9441e939a122e28f723e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff283b79-3c", "ovs_interfaceid": "ff283b79-3cdf-4b42-8cda-fdf4a30102c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG os_vif [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff283b79-3c, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c3c9f95-cc67-4e7c-92d3-8207ab53e206) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:53 user nova-compute[75026]: INFO os_vif [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:62:45,bridge_name='br-int',has_traffic_filtering=True,id=ff283b79-3cdf-4b42-8cda-fdf4a30102c6,network=Network(c165f418-f237-4588-bbb3-bf971687a8a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff283b79-3c')
Nov 10 20:01:53 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Deleting instance files /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef_del
Nov 10 20:01:53 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Deletion of /opt/stack/data/nova/instances/c73e0db5-dc93-428f-bb36-eb42103e35ef_del complete
Nov 10 20:01:53 user nova-compute[75026]: INFO nova.compute.manager [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 10 20:01:53 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:01:53 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG nova.compute.manager [req-8abb502b-892a-461c-bd89-80cdb18f7c30 req-287e156b-8d6d-40b2-8057-d765eb584d13 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-changed-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG nova.compute.manager [req-8abb502b-892a-461c-bd89-80cdb18f7c30 req-287e156b-8d6d-40b2-8057-d765eb584d13 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Refreshing instance network info cache due to event network-changed-6d624b2a-7779-45da-bc34-617b60e9acd5. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8abb502b-892a-461c-bd89-80cdb18f7c30 req-287e156b-8d6d-40b2-8057-d765eb584d13 service nova] Acquiring lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8abb502b-892a-461c-bd89-80cdb18f7c30 req-287e156b-8d6d-40b2-8057-d765eb584d13 service nova] Acquired lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG nova.network.neutron [req-8abb502b-892a-461c-bd89-80cdb18f7c30 req-287e156b-8d6d-40b2-8057-d765eb584d13 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Refreshing network info cache for port 6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:54 user nova-compute[75026]: INFO nova.compute.manager [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Terminating instance
Nov 10 20:01:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d3f3072-729e-4668-b332-1aef1bef35a5 req-ba02e1a9-f352-429f-895c-e38cff8f3ccb service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-vif-unplugged-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d3f3072-729e-4668-b332-1aef1bef35a5 req-ba02e1a9-f352-429f-895c-e38cff8f3ccb service nova] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d3f3072-729e-4668-b332-1aef1bef35a5 req-ba02e1a9-f352-429f-895c-e38cff8f3ccb service nova] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d3f3072-729e-4668-b332-1aef1bef35a5 req-ba02e1a9-f352-429f-895c-e38cff8f3ccb service nova] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d3f3072-729e-4668-b332-1aef1bef35a5 req-ba02e1a9-f352-429f-895c-e38cff8f3ccb service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] No waiting events found dispatching network-vif-unplugged-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d3f3072-729e-4668-b332-1aef1bef35a5 req-ba02e1a9-f352-429f-895c-e38cff8f3ccb service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-vif-unplugged-6d624b2a-7779-45da-bc34-617b60e9acd5 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 20:01:54 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:01:54 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Took 1.17 seconds to deallocate network for instance.
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.network.neutron [req-8abb502b-892a-461c-bd89-80cdb18f7c30 req-287e156b-8d6d-40b2-8057-d765eb584d13 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updated VIF entry in instance network info cache for port 6d624b2a-7779-45da-bc34-617b60e9acd5. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.network.neutron [req-8abb502b-892a-461c-bd89-80cdb18f7c30 req-287e156b-8d6d-40b2-8057-d765eb584d13 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updating instance_info_cache with network_info: [{"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:01:55 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Instance destroyed successfully.
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.objects.instance [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lazy-loading 'resources' on Instance uuid 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-757559947',display_name='tempest-TestStampPattern-server-757559947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-757559947',id=46,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgQJf+K5q9482jlgZcnbGU3mPdTxCa9QVlp+GK538Zi4nk447tX7z9aDvYXqC82MKGVm4iUZjP/MyQSczaZobWktrkPQfNgE3pr8E4SSuPbR+IHKrONBgSCKyqrJOCD3w==',key_name='tempest-TestStampPattern-3594168',keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:53:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7586dc2316c4a26b8a23491f430d07e',ramdisk_id='',reservation_id='r-njjy0wzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-60453673',owner_user_name='tempest-TestStampPattern-60453673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:57:25Z,user_data=None,user_id='bd6c5920b28543ab859267ec7278b317',uuid=5b89c7bd-bb17-4b9d-a4b2-02cc5af21666,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converting VIF {"id": "6d624b2a-7779-45da-bc34-617b60e9acd5", "address": "fa:16:3e:dc:42:5c", "network": {"id": "09bd3cdf-a31e-4e45-bf91-f7696d5184db", "bridge": "br-int", "label": "tempest-TestStampPattern-723771541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7586dc2316c4a26b8a23491f430d07e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d624b2a-77", "ovs_interfaceid": "6d624b2a-7779-45da-bc34-617b60e9acd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:42:5c,bridge_name='br-int',has_traffic_filtering=True,id=6d624b2a-7779-45da-bc34-617b60e9acd5,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d624b2a-77') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG os_vif [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:42:5c,bridge_name='br-int',has_traffic_filtering=True,id=6d624b2a-7779-45da-bc34-617b60e9acd5,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d624b2a-77') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-8abb502b-892a-461c-bd89-80cdb18f7c30 req-287e156b-8d6d-40b2-8057-d765eb584d13 service nova] Releasing lock "refresh_cache-5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d624b2a-77, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f1d1db9-c492-4d07-96d6-3aa69b56ac41) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:01:55 user nova-compute[75026]: INFO os_vif [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:42:5c,bridge_name='br-int',has_traffic_filtering=True,id=6d624b2a-7779-45da-bc34-617b60e9acd5,network=Network(09bd3cdf-a31e-4e45-bf91-f7696d5184db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d624b2a-77')
Nov 10 20:01:55 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Deleting instance files /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666_del
Nov 10 20:01:55 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Deletion of /opt/stack/data/nova/instances/5b89c7bd-bb17-4b9d-a4b2-02cc5af21666_del complete
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:55 user nova-compute[75026]: INFO nova.compute.manager [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:01:55 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Deleted allocations for instance c73e0db5-dc93-428f-bb36-eb42103e35ef
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-35cd617e-b73c-4f21-90e9-0eb9991b0bfd tempest-AttachVolumeShelveTestJSON-2009638513 tempest-AttachVolumeShelveTestJSON-2009638513-project-member] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-de859141-56e3-45b4-aa9c-b4ad32321802 req-8939f7af-8c22-4a72-8c55-0ed026e89a82 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-de859141-56e3-45b4-aa9c-b4ad32321802 req-8939f7af-8c22-4a72-8c55-0ed026e89a82 service nova] Acquiring lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-de859141-56e3-45b4-aa9c-b4ad32321802 req-8939f7af-8c22-4a72-8c55-0ed026e89a82 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-de859141-56e3-45b4-aa9c-b4ad32321802 req-8939f7af-8c22-4a72-8c55-0ed026e89a82 service nova] Lock "c73e0db5-dc93-428f-bb36-eb42103e35ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-de859141-56e3-45b4-aa9c-b4ad32321802 req-8939f7af-8c22-4a72-8c55-0ed026e89a82 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] No waiting events found dispatching network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:55 user nova-compute[75026]: WARNING nova.compute.manager [req-de859141-56e3-45b4-aa9c-b4ad32321802 req-8939f7af-8c22-4a72-8c55-0ed026e89a82 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received unexpected event network-vif-plugged-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 for instance with vm_state deleted and task_state None.
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:01:55 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Took 0.41 seconds to deallocate network for instance.
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:01:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:55 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Deleted allocations for instance 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666
Nov 10 20:01:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-fe6232e9-f46d-48bf-bf95-a2420eb048ef tempest-TestStampPattern-60453673 tempest-TestStampPattern-60453673-project-member] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:56 user nova-compute[75026]: DEBUG nova.compute.manager [req-fb0e2f98-93ab-4560-9924-d86defa5a33e req-5182f591-a585-4134-a0a6-f27bf02144e5 service nova] [instance: c73e0db5-dc93-428f-bb36-eb42103e35ef] Received event network-vif-deleted-ff283b79-3cdf-4b42-8cda-fdf4a30102c6 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:56 user nova-compute[75026]: DEBUG nova.compute.manager [req-fb0e2f98-93ab-4560-9924-d86defa5a33e req-5182f591-a585-4134-a0a6-f27bf02144e5 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fb0e2f98-93ab-4560-9924-d86defa5a33e req-5182f591-a585-4134-a0a6-f27bf02144e5 service nova] Acquiring lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:01:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fb0e2f98-93ab-4560-9924-d86defa5a33e req-5182f591-a585-4134-a0a6-f27bf02144e5 service nova] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:01:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fb0e2f98-93ab-4560-9924-d86defa5a33e req-5182f591-a585-4134-a0a6-f27bf02144e5 service nova] Lock "5b89c7bd-bb17-4b9d-a4b2-02cc5af21666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:01:56 user nova-compute[75026]: DEBUG nova.compute.manager [req-fb0e2f98-93ab-4560-9924-d86defa5a33e req-5182f591-a585-4134-a0a6-f27bf02144e5 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] No waiting events found dispatching network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:01:56 user nova-compute[75026]: WARNING nova.compute.manager [req-fb0e2f98-93ab-4560-9924-d86defa5a33e req-5182f591-a585-4134-a0a6-f27bf02144e5 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received unexpected event network-vif-plugged-6d624b2a-7779-45da-bc34-617b60e9acd5 for instance with vm_state deleted and task_state None.
Nov 10 20:01:56 user nova-compute[75026]: DEBUG nova.compute.manager [req-fb0e2f98-93ab-4560-9924-d86defa5a33e req-5182f591-a585-4134-a0a6-f27bf02144e5 service nova] [instance: 5b89c7bd-bb17-4b9d-a4b2-02cc5af21666] Received event network-vif-deleted-6d624b2a-7779-45da-bc34-617b60e9acd5 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:01:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:02:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:02:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:02:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:02:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:02:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:02:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:02:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:02:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:35 user nova-compute[75026]: INFO nova.compute.manager [None req-a1600504-169f-4dba-a165-7ca8d1c629aa tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Unrescuing
Nov 10 20:02:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1600504-169f-4dba-a165-7ca8d1c629aa tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1600504-169f-4dba-a165-7ca8d1c629aa tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquired lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-a1600504-169f-4dba-a165-7ca8d1c629aa tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG nova.network.neutron [None req-a1600504-169f-4dba-a165-7ca8d1c629aa tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-a1600504-169f-4dba-a165-7ca8d1c629aa tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Releasing lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG nova.objects.instance [None req-a1600504-169f-4dba-a165-7ca8d1c629aa tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'flavor' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-297d3b2e-e30d-42b7-89a0-5126be1d0ff6 req-33b38ee3-0cb0-4264-ad07-fb2b09eb1bc9 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:02:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-297d3b2e-e30d-42b7-89a0-5126be1d0ff6 req-33b38ee3-0cb0-4264-ad07-fb2b09eb1bc9 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:02:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-297d3b2e-e30d-42b7-89a0-5126be1d0ff6 req-33b38ee3-0cb0-4264-ad07-fb2b09eb1bc9 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:02:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-297d3b2e-e30d-42b7-89a0-5126be1d0ff6 req-33b38ee3-0cb0-4264-ad07-fb2b09eb1bc9 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:02:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-297d3b2e-e30d-42b7-89a0-5126be1d0ff6 req-33b38ee3-0cb0-4264-ad07-fb2b09eb1bc9 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:02:36 user nova-compute[75026]: WARNING nova.compute.manager [req-297d3b2e-e30d-42b7-89a0-5126be1d0ff6 req-33b38ee3-0cb0-4264-ad07-fb2b09eb1bc9 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state rescued and task_state unrescuing.
Nov 10 20:02:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance destroyed successfully.
Nov 10 20:02:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:02:38 user nova-compute[75026]: WARNING nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state rescued and task_state unrescuing.
Nov 10 20:02:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:02:38 user nova-compute[75026]: WARNING nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state rescued and task_state unrescuing.
Nov 10 20:02:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:02:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:02:38 user nova-compute[75026]: WARNING nova.compute.manager [req-7d9969c5-f6f3-4c3c-afc0-39f107fcf67d req-9d228b70-1843-428c-b889-2c3e9be063b1 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state rescued and task_state unrescuing.
Nov 10 20:02:39 user nova-compute[75026]: DEBUG nova.compute.manager [None req-a1600504-169f-4dba-a165-7ca8d1c629aa tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:02:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:02:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:02:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:02:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:02:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:02:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:02:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:02:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:02:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:02:45 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:02:45 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:02:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=25.11022186279297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:02:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:02:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:02:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:02:51 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:02:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:02:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:02:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 20:03:14 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 20:03:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:03:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:03:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:03:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:16 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:16 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 20:03:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:03:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:03:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:25 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:03:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:03:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:03:40 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:03:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:03:41 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:03:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:03:41 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:03:41 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:03:41 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:03:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:03:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:03:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:03:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:03:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:03:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:03:43 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:03:43 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:03:44 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:03:45 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:03:45 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:03:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.107620239257812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:03:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:03:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:03:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:51 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:03:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:03:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:03:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:03:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:03:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:04:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-070387f5-2dbd-4c37-a40a-d622ebf7d536 req-da82f4e6-78eb-49db-9b41-828987bcba03 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-changed-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:04:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-070387f5-2dbd-4c37-a40a-d622ebf7d536 req-da82f4e6-78eb-49db-9b41-828987bcba03 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Refreshing instance network info cache due to event network-changed-b924fdef-09ba-41ab-b72c-757a4ed14a64. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:04:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-070387f5-2dbd-4c37-a40a-d622ebf7d536 req-da82f4e6-78eb-49db-9b41-828987bcba03 service nova] Acquiring lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:04:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-070387f5-2dbd-4c37-a40a-d622ebf7d536 req-da82f4e6-78eb-49db-9b41-828987bcba03 service nova] Acquired lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:04:26 user nova-compute[75026]: DEBUG nova.network.neutron [req-070387f5-2dbd-4c37-a40a-d622ebf7d536 req-da82f4e6-78eb-49db-9b41-828987bcba03 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Refreshing network info cache for port b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:04:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:04:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:04:27 user nova-compute[75026]: INFO nova.compute.manager [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Detaching volume 124a0bfd-cf9a-499a-85c7-20678d974081
Nov 10 20:04:27 user nova-compute[75026]: INFO nova.virt.block_device [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Attempting to driver detach volume 124a0bfd-cf9a-499a-85c7-20678d974081 from mountpoint /dev/vdb
Nov 10 20:04:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Attempting to detach device vdb from instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 20:04:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 20:04:27 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:04:27 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:04:27 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:04:27 user nova-compute[75026]:   <serial>124a0bfd-cf9a-499a-85c7-20678d974081</serial>
Nov 10 20:04:27 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 20:04:27 user nova-compute[75026]: </disk>
Nov 10 20:04:27 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 20:04:27 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Successfully detached device vdb from instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 from the persistent domain config.
Nov 10 20:04:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 20:04:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 20:04:27 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:04:27 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:04:27 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:04:27 user nova-compute[75026]:   <serial>124a0bfd-cf9a-499a-85c7-20678d974081</serial>
Nov 10 20:04:27 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 20:04:27 user nova-compute[75026]: </disk>
Nov 10 20:04:27 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 20:04:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-070387f5-2dbd-4c37-a40a-d622ebf7d536 req-da82f4e6-78eb-49db-9b41-828987bcba03 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updated VIF entry in instance network info cache for port b924fdef-09ba-41ab-b72c-757a4ed14a64. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:04:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-070387f5-2dbd-4c37-a40a-d622ebf7d536 req-da82f4e6-78eb-49db-9b41-828987bcba03 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:04:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-070387f5-2dbd-4c37-a40a-d622ebf7d536 req-da82f4e6-78eb-49db-9b41-828987bcba03 service nova] Releasing lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:04:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 20:04:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-3a96c547-41eb-4916-bfec-8f4979c02196 req-e8a5d92c-f800-4de6-9941-51665ac51b7b service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-changed-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:04:28 user nova-compute[75026]: DEBUG nova.compute.manager [req-3a96c547-41eb-4916-bfec-8f4979c02196 req-e8a5d92c-f800-4de6-9941-51665ac51b7b service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Refreshing instance network info cache due to event network-changed-b924fdef-09ba-41ab-b72c-757a4ed14a64. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:04:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a96c547-41eb-4916-bfec-8f4979c02196 req-e8a5d92c-f800-4de6-9941-51665ac51b7b service nova] Acquiring lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:04:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a96c547-41eb-4916-bfec-8f4979c02196 req-e8a5d92c-f800-4de6-9941-51665ac51b7b service nova] Acquired lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:04:28 user nova-compute[75026]: DEBUG nova.network.neutron [req-3a96c547-41eb-4916-bfec-8f4979c02196 req-e8a5d92c-f800-4de6-9941-51665ac51b7b service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Refreshing network info cache for port b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:04:29 user nova-compute[75026]: DEBUG nova.network.neutron [req-3a96c547-41eb-4916-bfec-8f4979c02196 req-e8a5d92c-f800-4de6-9941-51665ac51b7b service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updated VIF entry in instance network info cache for port b924fdef-09ba-41ab-b72c-757a4ed14a64. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:04:29 user nova-compute[75026]: DEBUG nova.network.neutron [req-3a96c547-41eb-4916-bfec-8f4979c02196 req-e8a5d92c-f800-4de6-9941-51665ac51b7b service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [{"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:04:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-3a96c547-41eb-4916-bfec-8f4979c02196 req-e8a5d92c-f800-4de6-9941-51665ac51b7b service nova] Releasing lock "refresh_cache-15886f5c-4c07-4506-8f6d-fc9124ed2fe6" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:04:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:42 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:04:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:04:42 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:04:42 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:04:43 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updating instance_info_cache with network_info: [{"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:04:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-1d69dbab-693c-462e-b8e9-d53a4e311e30" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:04:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:04:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:04:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:47 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:04:47 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.09825897216797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:04:47 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 is timed out.
Nov 10 20:04:47 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Successfully detached device vdb from instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 from the live domain config.
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NDHTcnJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:04:47 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6afd4a4-4413-4056-9509-c69376accfc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 20:04:47 user nova-compute[75026]: No targets found.
Nov 10 20:04:47 user nova-compute[75026]: iSNS:
Nov 10 20:04:47 user nova-compute[75026]: No targets found.
Nov 10 20:04:47 user nova-compute[75026]: STATIC:
Nov 10 20:04:47 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081
Nov 10 20:04:47 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 20:04:47 user nova-compute[75026]:                 Iface Name: default
Nov 10 20:04:47 user nova-compute[75026]: FIRMWARE:
Nov 10 20:04:47 user nova-compute[75026]: No targets found.
Nov 10 20:04:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 20:04:47 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 20:04:47 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d49c83b-f036-4ff5-97e7-289c5270b004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b302aa-7bee-4167-b88f-ae015f4b34d8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 (non-flash)
Nov 10 20:04:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 (non-flash)
Nov 10 20:04:47 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda050c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2d71fd-2440-48b2-a442-2f126e580503]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7699b5a-c575-4867-af7a-199dbe220717]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2987e366-d216-4522-8da5-06a6e138982a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 20:04:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04db02c-0e32-4531-b872-4bee2547a842]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc5a68-bbb9-4aba-a907-4bf83cb1977c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e78294-54ec-4d59-89cb-aa1b03f4f8e0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081, portal: 172.16.0.220,3260]
Nov 10 20:04:48 user nova-compute[75026]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081, portal: 172.16.0.220,3260] successful.
Nov 10 20:04:48 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:124a0bfd-cf9a-499a-85c7-20678d974081 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f71553-f8f7-417f-bcbc-011271b1c9aa]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] <== disconnect_volume: return (276ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:04:48 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 20:04:49 user nova-compute[75026]: DEBUG nova.objects.instance [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'flavor' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:04:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0f865a26-ae29-4b3e-b92b-3ab2358193dd tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.871s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:04:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:51 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:04:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:04:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:04:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:04:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:04:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:05:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:05:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:05:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:05:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:05:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:05:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:05:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:05:17 user nova-compute[75026]: INFO nova.compute.manager [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Terminating instance
Nov 10 20:05:17 user nova-compute[75026]: DEBUG nova.compute.manager [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-16e4ac76-8dff-4cc4-b8d2-e0a2656ab253 req-1b380cbf-02a2-48ea-9490-3f4941df02ec service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16e4ac76-8dff-4cc4-b8d2-e0a2656ab253 req-1b380cbf-02a2-48ea-9490-3f4941df02ec service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16e4ac76-8dff-4cc4-b8d2-e0a2656ab253 req-1b380cbf-02a2-48ea-9490-3f4941df02ec service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-16e4ac76-8dff-4cc4-b8d2-e0a2656ab253 req-1b380cbf-02a2-48ea-9490-3f4941df02ec service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-16e4ac76-8dff-4cc4-b8d2-e0a2656ab253 req-1b380cbf-02a2-48ea-9490-3f4941df02ec service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:05:17 user nova-compute[75026]: DEBUG nova.compute.manager [req-16e4ac76-8dff-4cc4-b8d2-e0a2656ab253 req-1b380cbf-02a2-48ea-9490-3f4941df02ec service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-unplugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Instance destroyed successfully.
Nov 10 20:05:18 user nova-compute[75026]: DEBUG nova.objects.instance [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'resources' on Instance uuid 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-943681264',display_name='tempest-ServerRescueNegativeTestJSON-server-943681264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-943681264',id=49,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYMM+R8cnyQrOlyL+/tho6trX/akyP2QOOF40b/FXBOeSXJW/q3xViduU9BybQAJists388l16o9gc6iO7kloKaRU/YalCEiIYQMmAfPzTAwtnsIgv5K1hLgEsyz8XftQ==',key_name='tempest-keypair-1041471018',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-jve2rikm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T20:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=15886f5c-4c07-4506-8f6d-fc9124ed2fe6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "address": "fa:16:3e:98:ca:6a", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb924fdef-09", "ovs_interfaceid": "b924fdef-09ba-41ab-b72c-757a4ed14a64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=b924fdef-09ba-41ab-b72c-757a4ed14a64,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924fdef-09') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG os_vif [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=b924fdef-09ba-41ab-b72c-757a4ed14a64,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924fdef-09') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb924fdef-09, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e6a43f4-dc81-47d1-ae88-0a58b9b61cc8) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:05:18 user nova-compute[75026]: INFO os_vif [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=b924fdef-09ba-41ab-b72c-757a4ed14a64,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb924fdef-09')
Nov 10 20:05:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Deleting instance files /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6_del
Nov 10 20:05:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Deletion of /opt/stack/data/nova/instances/15886f5c-4c07-4506-8f6d-fc9124ed2fe6_del complete
Nov 10 20:05:18 user nova-compute[75026]: INFO nova.compute.manager [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 20:05:18 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:05:18 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:05:19 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Took 0.70 seconds to deallocate network for instance.
Nov 10 20:05:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-7bc7d308-2c67-49b9-8e1d-e949885e9431 req-35747ec1-7192-4408-ad1f-447b77c075c7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-deleted-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:05:19 user nova-compute[75026]: INFO nova.compute.manager [req-7bc7d308-2c67-49b9-8e1d-e949885e9431 req-35747ec1-7192-4408-ad1f-447b77c075c7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Neutron deleted interface b924fdef-09ba-41ab-b72c-757a4ed14a64; detaching it from the instance and deleting it from the info cache
Nov 10 20:05:19 user nova-compute[75026]: DEBUG nova.network.neutron [req-7bc7d308-2c67-49b9-8e1d-e949885e9431 req-35747ec1-7192-4408-ad1f-447b77c075c7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-7bc7d308-2c67-49b9-8e1d-e949885e9431 req-35747ec1-7192-4408-ad1f-447b77c075c7 service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Detach interface failed, port_id=b924fdef-09ba-41ab-b72c-757a4ed14a64, reason: Instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6 could not be found. {{(pid=75026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:05:19 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Deleted allocations for instance 15886f5c-4c07-4506-8f6d-fc9124ed2fe6
Nov 10 20:05:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-23a9fe19-2295-4eb8-8a6f-fe9ec6855976 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-75a6c7cc-63db-4652-a072-f3a98af9f000 req-168f0764-1121-4b7f-b6cc-66a159dbfa7d service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-75a6c7cc-63db-4652-a072-f3a98af9f000 req-168f0764-1121-4b7f-b6cc-66a159dbfa7d service nova] Acquiring lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-75a6c7cc-63db-4652-a072-f3a98af9f000 req-168f0764-1121-4b7f-b6cc-66a159dbfa7d service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-75a6c7cc-63db-4652-a072-f3a98af9f000 req-168f0764-1121-4b7f-b6cc-66a159dbfa7d service nova] Lock "15886f5c-4c07-4506-8f6d-fc9124ed2fe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:05:19 user nova-compute[75026]: DEBUG nova.compute.manager [req-75a6c7cc-63db-4652-a072-f3a98af9f000 req-168f0764-1121-4b7f-b6cc-66a159dbfa7d service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] No waiting events found dispatching network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:05:19 user nova-compute[75026]: WARNING nova.compute.manager [req-75a6c7cc-63db-4652-a072-f3a98af9f000 req-168f0764-1121-4b7f-b6cc-66a159dbfa7d service nova] [instance: 15886f5c-4c07-4506-8f6d-fc9124ed2fe6] Received unexpected event network-vif-plugged-b924fdef-09ba-41ab-b72c-757a4ed14a64 for instance with vm_state deleted and task_state None.
Nov 10 20:05:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:05:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:05:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:05:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 20:05:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:05:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:05:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:05:47 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:05:47 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:05:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:05:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:05:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:05:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=25.125579833984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 1d69dbab-693c-462e-b8e9-d53a4e311e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:05:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:05:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:05:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:05:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:05:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:06:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:06:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:06:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:06:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:06:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:06:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:06:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:06:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:06:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:06:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:28 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:06:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:06:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:06:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:06:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:06:32 user nova-compute[75026]: INFO nova.compute.manager [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Terminating instance
Nov 10 20:06:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:06:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-db0d0e28-1f23-493e-8d4d-6d6352757b39 req-650caeeb-ddbb-4c27-bca7-e7e97abb71b9 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-db0d0e28-1f23-493e-8d4d-6d6352757b39 req-650caeeb-ddbb-4c27-bca7-e7e97abb71b9 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-db0d0e28-1f23-493e-8d4d-6d6352757b39 req-650caeeb-ddbb-4c27-bca7-e7e97abb71b9 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-db0d0e28-1f23-493e-8d4d-6d6352757b39 req-650caeeb-ddbb-4c27-bca7-e7e97abb71b9 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-db0d0e28-1f23-493e-8d4d-6d6352757b39 req-650caeeb-ddbb-4c27-bca7-e7e97abb71b9 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-db0d0e28-1f23-493e-8d4d-6d6352757b39 req-650caeeb-ddbb-4c27-bca7-e7e97abb71b9 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-unplugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Instance destroyed successfully.
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.objects.instance [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'resources' on Instance uuid 1d69dbab-693c-462e-b8e9-d53a4e311e30 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1152529874',display_name='tempest-ServerRescueNegativeTestJSON-server-1152529874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1152529874',id=44,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-omi3z18y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:51:43Z,user_data=None,user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=1d69dbab-693c-462e-b8e9-d53a4e311e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "address": "fa:16:3e:da:5a:01", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4dac984-0d", "ovs_interfaceid": "b4dac984-0d9c-4ce9-9024-7ce2f87e4048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=b4dac984-0d9c-4ce9-9024-7ce2f87e4048,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dac984-0d') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG os_vif [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=b4dac984-0d9c-4ce9-9024-7ce2f87e4048,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dac984-0d') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4dac984-0d, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b57989c9-9ba6-4724-9857-b155c0a4dbd0) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:06:33 user nova-compute[75026]: INFO os_vif [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=b4dac984-0d9c-4ce9-9024-7ce2f87e4048,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4dac984-0d')
Nov 10 20:06:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Deleting instance files /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30_del
Nov 10 20:06:33 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Deletion of /opt/stack/data/nova/instances/1d69dbab-693c-462e-b8e9-d53a4e311e30_del complete
Nov 10 20:06:33 user nova-compute[75026]: INFO nova.compute.manager [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 20:06:33 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:06:33 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:06:34 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:06:34 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Took 0.48 seconds to deallocate network for instance.
Nov 10 20:06:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:06:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:06:34 user nova-compute[75026]: DEBUG nova.compute.manager [req-4d91fb50-4047-4f6d-a2ce-6f5dcfe19ce7 req-a4d89dbd-e716-4654-b89c-9aee9c09d886 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-deleted-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:06:34 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:06:34 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:06:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:06:34 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Deleted allocations for instance 1d69dbab-693c-462e-b8e9-d53a4e311e30
Nov 10 20:06:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-4542dd59-74cf-4f2f-8786-9b3688f973c2 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.749s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:06:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-fba3e9db-59d5-4d9e-822e-3c86d42f35d4 req-97f15619-fcbd-455b-bf3a-68fa23e65304 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:06:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fba3e9db-59d5-4d9e-822e-3c86d42f35d4 req-97f15619-fcbd-455b-bf3a-68fa23e65304 service nova] Acquiring lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:06:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fba3e9db-59d5-4d9e-822e-3c86d42f35d4 req-97f15619-fcbd-455b-bf3a-68fa23e65304 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:06:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-fba3e9db-59d5-4d9e-822e-3c86d42f35d4 req-97f15619-fcbd-455b-bf3a-68fa23e65304 service nova] Lock "1d69dbab-693c-462e-b8e9-d53a4e311e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:06:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-fba3e9db-59d5-4d9e-822e-3c86d42f35d4 req-97f15619-fcbd-455b-bf3a-68fa23e65304 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] No waiting events found dispatching network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:06:35 user nova-compute[75026]: WARNING nova.compute.manager [req-fba3e9db-59d5-4d9e-822e-3c86d42f35d4 req-97f15619-fcbd-455b-bf3a-68fa23e65304 service nova] [instance: 1d69dbab-693c-462e-b8e9-d53a4e311e30] Received unexpected event network-vif-plugged-b4dac984-0d9c-4ce9-9024-7ce2f87e4048 for instance with vm_state deleted and task_state None.
Nov 10 20:06:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:42 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:06:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:06:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:06:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:06:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:06:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:06:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [{"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:06:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-39176d38-43bf-49b4-8f64-cd16b5ada8a7" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:06:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:06:44 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:46 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:06:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:06:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:06:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:06:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.152862548828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:06:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:06:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:06:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:06:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:06:58 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:03 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:08 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:13 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:18 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:07:23 user nova-compute[75026]: INFO nova.compute.manager [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Terminating instance
Nov 10 20:07:23 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:23 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-7625b97c-1a4e-4a67-9d5d-7e35e65c96df req-900ac1f2-f9a1-4792-92d2-a9fc31c5b475 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7625b97c-1a4e-4a67-9d5d-7e35e65c96df req-900ac1f2-f9a1-4792-92d2-a9fc31c5b475 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7625b97c-1a4e-4a67-9d5d-7e35e65c96df req-900ac1f2-f9a1-4792-92d2-a9fc31c5b475 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7625b97c-1a4e-4a67-9d5d-7e35e65c96df req-900ac1f2-f9a1-4792-92d2-a9fc31c5b475 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-7625b97c-1a4e-4a67-9d5d-7e35e65c96df req-900ac1f2-f9a1-4792-92d2-a9fc31c5b475 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-7625b97c-1a4e-4a67-9d5d-7e35e65c96df req-900ac1f2-f9a1-4792-92d2-a9fc31c5b475 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-unplugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Instance destroyed successfully.
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lazy-loading 'resources' on Instance uuid 39176d38-43bf-49b4-8f64-cd16b5ada8a7 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T19:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-864115750',display_name='tempest-ServerRescueNegativeTestJSON-server-864115750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-864115750',id=43,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T19:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d8f446a3094348839f9216faff0485',ramdisk_id='',reservation_id='r-9ybrbs1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1130240525',owner_user_name='tempest-ServerRescueNegativeTestJSON-1130240525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T19:56:30Z,user_data=None,user_id='b7ef73abaece4f08b00d81d403a8a66a',uuid=39176d38-43bf-49b4-8f64-cd16b5ada8a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converting VIF {"id": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "address": "fa:16:3e:2e:ae:d8", "network": {"id": "f86fcdf2-8cd3-48d1-b472-97e40915843c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1240973252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d8f446a3094348839f9216faff0485", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c048fe-3b", "ovs_interfaceid": "21c048fe-3b5b-4287-bf6e-f5df5a6812fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ae:d8,bridge_name='br-int',has_traffic_filtering=True,id=21c048fe-3b5b-4287-bf6e-f5df5a6812fa,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c048fe-3b') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG os_vif [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ae:d8,bridge_name='br-int',has_traffic_filtering=True,id=21c048fe-3b5b-4287-bf6e-f5df5a6812fa,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c048fe-3b') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21c048fe-3b, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c7e1dea-aef1-4128-bf20-9d77ed13803e) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:24 user nova-compute[75026]: INFO os_vif [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ae:d8,bridge_name='br-int',has_traffic_filtering=True,id=21c048fe-3b5b-4287-bf6e-f5df5a6812fa,network=Network(f86fcdf2-8cd3-48d1-b472-97e40915843c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c048fe-3b')
Nov 10 20:07:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Deleting instance files /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7_del
Nov 10 20:07:24 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Deletion of /opt/stack/data/nova/instances/39176d38-43bf-49b4-8f64-cd16b5ada8a7_del complete
Nov 10 20:07:24 user nova-compute[75026]: INFO nova.compute.manager [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 10 20:07:24 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:07:24 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Took 0.36 seconds to deallocate network for instance.
Nov 10 20:07:24 user nova-compute[75026]: DEBUG nova.compute.manager [req-229ffc9a-e8b6-4ea6-9c86-f058eabbf54c req-8a7ccf55-02e2-4c2a-bb87-70d00ad3f660 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-deleted-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:07:24 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:07:25 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:07:25 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:07:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:07:25 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Deleted allocations for instance 39176d38-43bf-49b4-8f64-cd16b5ada8a7
Nov 10 20:07:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ce610a97-f319-4871-8a86-dfa82a278d59 tempest-ServerRescueNegativeTestJSON-1130240525 tempest-ServerRescueNegativeTestJSON-1130240525-project-member] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.506s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:07:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-63f392e2-e85e-41eb-ad75-e6aaa8fdcef8 req-4518ce5d-f8c0-4647-9e5d-c12780cea0f3 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:07:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-63f392e2-e85e-41eb-ad75-e6aaa8fdcef8 req-4518ce5d-f8c0-4647-9e5d-c12780cea0f3 service nova] Acquiring lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:07:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-63f392e2-e85e-41eb-ad75-e6aaa8fdcef8 req-4518ce5d-f8c0-4647-9e5d-c12780cea0f3 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:07:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-63f392e2-e85e-41eb-ad75-e6aaa8fdcef8 req-4518ce5d-f8c0-4647-9e5d-c12780cea0f3 service nova] Lock "39176d38-43bf-49b4-8f64-cd16b5ada8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:07:26 user nova-compute[75026]: DEBUG nova.compute.manager [req-63f392e2-e85e-41eb-ad75-e6aaa8fdcef8 req-4518ce5d-f8c0-4647-9e5d-c12780cea0f3 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] No waiting events found dispatching network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:07:26 user nova-compute[75026]: WARNING nova.compute.manager [req-63f392e2-e85e-41eb-ad75-e6aaa8fdcef8 req-4518ce5d-f8c0-4647-9e5d-c12780cea0f3 service nova] [instance: 39176d38-43bf-49b4-8f64-cd16b5ada8a7] Received unexpected event network-vif-plugged-21c048fe-3b5b-4287-bf6e-f5df5a6812fa for instance with vm_state deleted and task_state None.
Nov 10 20:07:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:07:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:07:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 20:07:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:07:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:07:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:07:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:44 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:07:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:07:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:07:48 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:07:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:07:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:07:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=25.18041229248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:07:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:07:51 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:07:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:07:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:07:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:08:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:08:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:08:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:08:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:08:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:08:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:22 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:22 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 20:08:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 20:08:25 user nova-compute[75026]: INFO nova.compute.claims [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Claim successful on node user
Nov 10 20:08:25 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 20:08:25 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 20:08:25 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 20:08:25 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.policy [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3982ce75922144be8381f6dc9ee3f706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab34f478806f4280892268b11c3da88a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 20:08:26 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Creating image(s)
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.187s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.194s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk 1073741824" returned: 0 in 0.050s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Successfully created port: ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Cannot resize image /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Ensure instance console log exists: /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Successfully updated port: ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-319e63e5-ba72-40e7-9bdb-05c3571ce15a req-2bd0be02-6cfd-4aa7-9f49-6d0dbecd93b3 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-changed-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.compute.manager [req-319e63e5-ba72-40e7-9bdb-05c3571ce15a req-2bd0be02-6cfd-4aa7-9f49-6d0dbecd93b3 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Refreshing instance network info cache due to event network-changed-ccb605a1-ff54-441d-88b8-e09107cd24c8. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-319e63e5-ba72-40e7-9bdb-05c3571ce15a req-2bd0be02-6cfd-4aa7-9f49-6d0dbecd93b3 service nova] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.neutron [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance network_info: |[{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-319e63e5-ba72-40e7-9bdb-05c3571ce15a req-2bd0be02-6cfd-4aa7-9f49-6d0dbecd93b3 service nova] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.neutron [req-319e63e5-ba72-40e7-9bdb-05c3571ce15a req-2bd0be02-6cfd-4aa7-9f49-6d0dbecd93b3 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Refreshing network info cache for port ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Start _get_guest_xml network_info=[{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 20:08:27 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:08:27 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T20:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.objects.instance [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'pci_devices' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] End _get_guest_xml xml=<domain type="kvm">
Nov 10 20:08:27 user nova-compute[75026]:   <uuid>fc3e47bb-477e-416a-9183-c84ac841ac48</uuid>
Nov 10 20:08:27 user nova-compute[75026]:   <name>instance-00000032</name>
Nov 10 20:08:27 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 20:08:27 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 20:08:27 user nova-compute[75026]:   <metadata>
Nov 10 20:08:27 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 20:08:27 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 20:08:27 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeTestJSON-server-256599166</nova:name>
Nov 10 20:08:27 user nova-compute[75026]:       <nova:creationTime>2023-11-10 20:08:27</nova:creationTime>
Nov 10 20:08:27 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 20:08:27 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 20:08:27 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 20:08:27 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 20:08:27 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 20:08:27 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 20:08:27 user nova-compute[75026]:       </nova:flavor>
Nov 10 20:08:27 user nova-compute[75026]:       <nova:owner>
Nov 10 20:08:27 user nova-compute[75026]:         <nova:user uuid="3982ce75922144be8381f6dc9ee3f706">tempest-AttachVolumeTestJSON-636130646-project-member</nova:user>
Nov 10 20:08:27 user nova-compute[75026]:         <nova:project uuid="ab34f478806f4280892268b11c3da88a">tempest-AttachVolumeTestJSON-636130646</nova:project>
Nov 10 20:08:27 user nova-compute[75026]:       </nova:owner>
Nov 10 20:08:27 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 20:08:27 user nova-compute[75026]:       <nova:ports>
Nov 10 20:08:27 user nova-compute[75026]:         <nova:port uuid="ccb605a1-ff54-441d-88b8-e09107cd24c8">
Nov 10 20:08:27 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 20:08:27 user nova-compute[75026]:         </nova:port>
Nov 10 20:08:27 user nova-compute[75026]:       </nova:ports>
Nov 10 20:08:27 user nova-compute[75026]:     </nova:instance>
Nov 10 20:08:27 user nova-compute[75026]:   </metadata>
Nov 10 20:08:27 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 20:08:27 user nova-compute[75026]:     <system>
Nov 10 20:08:27 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 20:08:27 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 20:08:27 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 20:08:27 user nova-compute[75026]:       <entry name="serial">fc3e47bb-477e-416a-9183-c84ac841ac48</entry>
Nov 10 20:08:27 user nova-compute[75026]:       <entry name="uuid">fc3e47bb-477e-416a-9183-c84ac841ac48</entry>
Nov 10 20:08:27 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 20:08:27 user nova-compute[75026]:     </system>
Nov 10 20:08:27 user nova-compute[75026]:   </sysinfo>
Nov 10 20:08:27 user nova-compute[75026]:   <os>
Nov 10 20:08:27 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 20:08:27 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 20:08:27 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 20:08:27 user nova-compute[75026]:   </os>
Nov 10 20:08:27 user nova-compute[75026]:   <features>
Nov 10 20:08:27 user nova-compute[75026]:     <acpi/>
Nov 10 20:08:27 user nova-compute[75026]:     <apic/>
Nov 10 20:08:27 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 20:08:27 user nova-compute[75026]:   </features>
Nov 10 20:08:27 user nova-compute[75026]:   <clock offset="utc">
Nov 10 20:08:27 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 20:08:27 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 20:08:27 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 20:08:27 user nova-compute[75026]:   </clock>
Nov 10 20:08:27 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 20:08:27 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 20:08:27 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 20:08:27 user nova-compute[75026]:   </cpu>
Nov 10 20:08:27 user nova-compute[75026]:   <devices>
Nov 10 20:08:27 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 20:08:27 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 20:08:27 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk"/>
Nov 10 20:08:27 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 20:08:27 user nova-compute[75026]:     </disk>
Nov 10 20:08:27 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 20:08:27 user nova-compute[75026]:       <mac address="fa:16:3e:b8:20:90"/>
Nov 10 20:08:27 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:08:27 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 20:08:27 user nova-compute[75026]:       <target dev="tapccb605a1-ff"/>
Nov 10 20:08:27 user nova-compute[75026]:     </interface>
Nov 10 20:08:27 user nova-compute[75026]:     <serial type="pty">
Nov 10 20:08:27 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/console.log" append="off"/>
Nov 10 20:08:27 user nova-compute[75026]:     </serial>
Nov 10 20:08:27 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 20:08:27 user nova-compute[75026]:     <video>
Nov 10 20:08:27 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:08:27 user nova-compute[75026]:     </video>
Nov 10 20:08:27 user nova-compute[75026]:     <rng model="virtio">
Nov 10 20:08:27 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 20:08:27 user nova-compute[75026]:     </rng>
Nov 10 20:08:27 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 20:08:27 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 20:08:27 user nova-compute[75026]:       <stats period="10"/>
Nov 10 20:08:27 user nova-compute[75026]:     </memballoon>
Nov 10 20:08:27 user nova-compute[75026]:   </devices>
Nov 10 20:08:27 user nova-compute[75026]: </domain>
Nov 10 20:08:27 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T20:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG os_vif [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '013b3b09-baed-5978-badf-4b300d79ab2d', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccb605a1-ff, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccb605a1-ff, col_values=(('qos', UUID('09929540-165a-4f5c-ae8a-f1b7e7cfeb30')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccb605a1-ff, col_values=(('external_ids', {'iface-id': 'ccb605a1-ff54-441d-88b8-e09107cd24c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:20:90', 'vm-uuid': 'fc3e47bb-477e-416a-9183-c84ac841ac48'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:27 user nova-compute[75026]: INFO os_vif [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff')
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:08:27 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No VIF found with MAC fa:16:3e:b8:20:90, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 20:08:28 user nova-compute[75026]: DEBUG nova.network.neutron [req-319e63e5-ba72-40e7-9bdb-05c3571ce15a req-2bd0be02-6cfd-4aa7-9f49-6d0dbecd93b3 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated VIF entry in instance network info cache for port ccb605a1-ff54-441d-88b8-e09107cd24c8. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:08:28 user nova-compute[75026]: DEBUG nova.network.neutron [req-319e63e5-ba72-40e7-9bdb-05c3571ce15a req-2bd0be02-6cfd-4aa7-9f49-6d0dbecd93b3 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:08:28 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-319e63e5-ba72-40e7-9bdb-05c3571ce15a req-2bd0be02-6cfd-4aa7-9f49-6d0dbecd93b3 service nova] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-9f235cf7-da47-4a03-8e17-e2aecb6bbc87 req-21511115-902d-42bb-8168-fbd06fdd38a0 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f235cf7-da47-4a03-8e17-e2aecb6bbc87 req-21511115-902d-42bb-8168-fbd06fdd38a0 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f235cf7-da47-4a03-8e17-e2aecb6bbc87 req-21511115-902d-42bb-8168-fbd06fdd38a0 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9f235cf7-da47-4a03-8e17-e2aecb6bbc87 req-21511115-902d-42bb-8168-fbd06fdd38a0 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG nova.compute.manager [req-9f235cf7-da47-4a03-8e17-e2aecb6bbc87 req-21511115-902d-42bb-8168-fbd06fdd38a0 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:08:29 user nova-compute[75026]: WARNING nova.compute.manager [req-9f235cf7-da47-4a03-8e17-e2aecb6bbc87 req-21511115-902d-42bb-8168-fbd06fdd38a0 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state building and task_state spawning.
Nov 10 20:08:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:29 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 20:08:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance spawned successfully.
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:08:31 user nova-compute[75026]: INFO nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:08:31 user nova-compute[75026]: INFO nova.compute.manager [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Took 5.81 seconds to build instance.
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-25d9423f-35f9-4aaf-afe2-d6f71b8605bb req-a8264a53-0ae1-46df-b965-92d279187db5 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-25d9423f-35f9-4aaf-afe2-d6f71b8605bb req-a8264a53-0ae1-46df-b965-92d279187db5 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-25d9423f-35f9-4aaf-afe2-d6f71b8605bb req-a8264a53-0ae1-46df-b965-92d279187db5 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-25d9423f-35f9-4aaf-afe2-d6f71b8605bb req-a8264a53-0ae1-46df-b965-92d279187db5 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-25d9423f-35f9-4aaf-afe2-d6f71b8605bb req-a8264a53-0ae1-46df-b965-92d279187db5 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:08:31 user nova-compute[75026]: WARNING nova.compute.manager [req-25d9423f-35f9-4aaf-afe2-d6f71b8605bb req-a8264a53-0ae1-46df-b965-92d279187db5 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state active and task_state None.
Nov 10 20:08:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-9aa4694c-b316-4127-9f24-cbf3897fb2b5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.125s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:31 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:39 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:43 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:08:43 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:08:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:08:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:08:43 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:08:43 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:08:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:08:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:08:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:08:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:08:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:48 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:08:48 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:08:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:08:49 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=25.15194320678711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:08:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:08:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:51 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:51 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:54 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:08:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:08:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:08:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:44 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:09:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:09:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:09:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:09:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:09:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:09:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:09:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:09:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:09:46 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:49 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:09:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:09:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:09:50 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:09:50 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:09:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:09:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:09:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=25.149669647216797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:09:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:09:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:09:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:09:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:09:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:09:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:09:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:09:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:10:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa4c19cc-3f11-40a2-892a-80fa2349848c req-1cf69bcd-40ec-4feb-839a-e86c7e278936 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-changed-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:10:16 user nova-compute[75026]: DEBUG nova.compute.manager [req-aa4c19cc-3f11-40a2-892a-80fa2349848c req-1cf69bcd-40ec-4feb-839a-e86c7e278936 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Refreshing instance network info cache due to event network-changed-ccb605a1-ff54-441d-88b8-e09107cd24c8. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:10:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa4c19cc-3f11-40a2-892a-80fa2349848c req-1cf69bcd-40ec-4feb-839a-e86c7e278936 service nova] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:10:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa4c19cc-3f11-40a2-892a-80fa2349848c req-1cf69bcd-40ec-4feb-839a-e86c7e278936 service nova] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:10:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-aa4c19cc-3f11-40a2-892a-80fa2349848c req-1cf69bcd-40ec-4feb-839a-e86c7e278936 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Refreshing network info cache for port ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:10:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-aa4c19cc-3f11-40a2-892a-80fa2349848c req-1cf69bcd-40ec-4feb-839a-e86c7e278936 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated VIF entry in instance network info cache for port ccb605a1-ff54-441d-88b8-e09107cd24c8. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:10:16 user nova-compute[75026]: DEBUG nova.network.neutron [req-aa4c19cc-3f11-40a2-892a-80fa2349848c req-1cf69bcd-40ec-4feb-839a-e86c7e278936 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:10:16 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-aa4c19cc-3f11-40a2-892a-80fa2349848c req-1cf69bcd-40ec-4feb-839a-e86c7e278936 service nova] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:10:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:10:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG nova.objects.instance [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:10:22 user nova-compute[75026]: INFO nova.compute.manager [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Attaching volume 19c5d66e-cf11-4915-8130-0bec88f1c137 to /dev/vdb
Nov 10 20:10:22 user nova-compute[75026]: DEBUG os_brick.utils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fc750f-577f-4ecd-9d62-4eab87888e6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:22 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41469f9-72d0-485d-bef6-8e0c1e4f5f4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65209509-6712-47bf-8471-6d7a4921b57d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3affe50d-a8a8-4370-b8fe-b401d2f0f391]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 20:10:23 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 20:10:23 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b540ab-4ccd-4ede-8a87-f05694324bba]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG os_brick.utils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:10:23 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating existing volume attachment record: 499588d6-decc-4d85-a19b-2097cc7f5600 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 20:10:24 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:10:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:10:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:44 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:10:44 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:10:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:10:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:10:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:10:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:10:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:10:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:10:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CROpouIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:10:46 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:10:46 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:10:46 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10539cc0-b9e6-42e3-9596-e1117ca5a3be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 20:10:46 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c924169e-bc5f-4af8-8978-c33e6d8d0463]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137] added
Nov 10 20:10:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5567b-70fb-438d-86c3-66876802098a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1b3b9e-4ec6-40d4-8462-ece970b715e9]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CROpouIc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CROpouIc" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[be716f8e-17ec-4753-8d4d-11e9207d8845]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CROpouIc'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec9af18-19dd-4a9f-90f0-06d6a1baa013]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9acd6-781e-42f1-b432-e5f56a52697e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 20:10:46 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 20:10:46 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:10:46 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 20:10:46 user nova-compute[75026]: 
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddff419d-9e81-4042-8019-8d427aa0a0ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260]
Nov 10 20:10:46 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260] successful.
Nov 10 20:10:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa60d3-8dd1-4c7a-bff4-3095e0729546]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c0325-c76b-4c53-bda9-eda4bed95895]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)
Nov 10 20:10:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)
Nov 10 20:10:46 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f1eb2c-24fe-4717-a0dc-478730ae8f96]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 20:10:46 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CROpouIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26463383064616364', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463383064616364', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG nova.objects.instance [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 20:10:47 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:10:47 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:10:47 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:10:47 user nova-compute[75026]:   <serial>19c5d66e-cf11-4915-8130-0bec88f1c137</serial>
Nov 10 20:10:47 user nova-compute[75026]: </disk>
Nov 10 20:10:47 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No VIF found with MAC fa:16:3e:b8:20:90, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-46988663-405f-480b-ad90-fa97fed44005 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.082s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-15e1f3d3-3c02-4f0b-a769-cbf8c6178783 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-15e1f3d3-3c02-4f0b-a769-cbf8c6178783 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-15e1f3d3-3c02-4f0b-a769-cbf8c6178783 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-15e1f3d3-3c02-4f0b-a769-cbf8c6178783 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75026) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG nova.objects.instance [None req-15e1f3d3-3c02-4f0b-a769-cbf8c6178783 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:48 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-0651ece5-c81c-4e85-8915-8d2ab53edad0 req-48f595ac-a9bc-4a77-8d7b-785894c27704 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:10:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0651ece5-c81c-4e85-8915-8d2ab53edad0 req-48f595ac-a9bc-4a77-8d7b-785894c27704 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:10:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0651ece5-c81c-4e85-8915-8d2ab53edad0 req-48f595ac-a9bc-4a77-8d7b-785894c27704 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:10:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-0651ece5-c81c-4e85-8915-8d2ab53edad0 req-48f595ac-a9bc-4a77-8d7b-785894c27704 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:10:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-0651ece5-c81c-4e85-8915-8d2ab53edad0 req-48f595ac-a9bc-4a77-8d7b-785894c27704 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:10:49 user nova-compute[75026]: WARNING nova.compute.manager [req-0651ece5-c81c-4e85-8915-8d2ab53edad0 req-48f595ac-a9bc-4a77-8d7b-785894c27704 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state active and task_state powering-off.
Nov 10 20:10:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:49 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance destroyed successfully.
Nov 10 20:10:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-15e1f3d3-3c02-4f0b-a769-cbf8c6178783 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:10:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-15e1f3d3-3c02-4f0b-a769-cbf8c6178783 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.860s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:10:49 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:10:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:10:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:10:50 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:10:50 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-12815a3f-1dfa-4aef-aff6-70191ec9dadd req-93ddef79-5f19-40c4-bcdc-561b3b22c218 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12815a3f-1dfa-4aef-aff6-70191ec9dadd req-93ddef79-5f19-40c4-bcdc-561b3b22c218 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12815a3f-1dfa-4aef-aff6-70191ec9dadd req-93ddef79-5f19-40c4-bcdc-561b3b22c218 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-12815a3f-1dfa-4aef-aff6-70191ec9dadd req-93ddef79-5f19-40c4-bcdc-561b3b22c218 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.compute.manager [req-12815a3f-1dfa-4aef-aff6-70191ec9dadd req-93ddef79-5f19-40c4-bcdc-561b3b22c218 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:10:51 user nova-compute[75026]: WARNING nova.compute.manager [req-12815a3f-1dfa-4aef-aff6-70191ec9dadd req-93ddef79-5f19-40c4-bcdc-561b3b22c218 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state stopped and task_state None.
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:10:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:10:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=25.148544311523438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:10:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:10:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:10:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:10:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:10:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:10:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:10:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:10:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:11:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:11:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:11:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:11:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:11:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:11:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:11:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:11:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:11:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:11:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:11:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:11:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:11:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:11:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:11:46 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:11:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:11:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:11:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:11:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:11:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:11:50 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:11:50 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:11:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:11:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:11:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9131MB free_disk=25.14794921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:11:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:11:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:11:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:11:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:11:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:11:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:11:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:11:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:11:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:12:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:12:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:12:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:12:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:12:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:12:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.objects.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.network.neutron [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:12:39 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance destroyed successfully.
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'resources' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.objects.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T20:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:12:39 user nova-compute[75026]: DEBUG os_vif [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccb605a1-ff, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09929540-165a-4f5c-ae8a-f1b7e7cfeb30) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:40 user nova-compute[75026]: INFO os_vif [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff')
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CROpouIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:12:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0632334-1b86-421b-b409-6580235a182d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 20:12:40 user nova-compute[75026]: No targets found.
Nov 10 20:12:40 user nova-compute[75026]: iSNS:
Nov 10 20:12:40 user nova-compute[75026]: No targets found.
Nov 10 20:12:40 user nova-compute[75026]: STATIC:
Nov 10 20:12:40 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137
Nov 10 20:12:40 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 20:12:40 user nova-compute[75026]:                 Iface Name: default
Nov 10 20:12:40 user nova-compute[75026]: FIRMWARE:
Nov 10 20:12:40 user nova-compute[75026]: No targets found.
Nov 10 20:12:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 20:12:40 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 20:12:40 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f9d13f-2136-4854-b352-99d94be54f5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe24c44-111c-4144-b1f0-60a655925725]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)
Nov 10 20:12:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)
Nov 10 20:12:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feda3c2b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a5b278-81b3-414d-9c4e-9f1390fc0789]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93181ca-2aa3-4f6a-b1eb-456b2d602253]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[014beea6-373a-4a20-b4ac-11aa8fb47994]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fb1d8b-bf47-41b2-a2c0-dbdc8d7c0c0d]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b7133f-f002-4b17-9ecd-987e756afed3]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e96cb13-6016-4006-9c5a-ad453e437afc]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260]
Nov 10 20:12:40 user nova-compute[75026]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260] successful.
Nov 10 20:12:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f31b6d7-7fce-4058-aac0-5f0daf4de347]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== disconnect_volume: return (278ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Start _get_guest_xml network_info=[{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '499588d6-decc-4d85-a19b-2097cc7f5600', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CROpouIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fc3e47bb-477e-416a-9183-c84ac841ac48', 'attached_at': '', 'detached_at': '', 'volume_id': '19c5d66e-cf11-4915-8130-0bec88f1c137', 'serial': '19c5d66e-cf11-4915-8130-0bec88f1c137'}, 'volume_type': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'numa_topology' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.objects.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:12:40 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:12:40 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.objects.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CROpouIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:12:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:12:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:12:40 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[370dbdcf-c556-48e6-a3ea-0ecd8868d396]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 20:12:40 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3611a2e-4128-4c28-b61b-5e6ed04e63a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137] added
Nov 10 20:12:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1476d99d-3e78-4c17-b076-000bd503d09a]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbe5141-1c95-42bd-a48f-fc1fe08ab217]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CROpouIc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CROpouIc" returned: 0 in 0.023s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f224609-b2d8-4dd9-8a29-b33a3ffe91e8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CROpouIc'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[625d93d1-2c61-4a1d-8629-619018a18dce]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9c51f-2a07-4fd7-9a30-64a8f45614d6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 20:12:40 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 20:12:40 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:12:40 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 20:12:40 user nova-compute[75026]: 
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29cb036-6690-4b0d-9b37-801977a82bb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260]
Nov 10 20:12:40 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260] successful.
Nov 10 20:12:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61ca60f-2025-460c-a901-9895a97c935c]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62c6b62-2b19-465d-91b9-30370e5c7520]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)
Nov 10 20:12:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)
Nov 10 20:12:40 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b9758-2273-41f1-b40e-5cd191f464bc]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 20:12:40 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CROpouIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26463383064616364', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463383064616364', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T20:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'pci_devices' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG nova.objects.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] End _get_guest_xml xml=<domain type="kvm">
Nov 10 20:12:41 user nova-compute[75026]:   <uuid>fc3e47bb-477e-416a-9183-c84ac841ac48</uuid>
Nov 10 20:12:41 user nova-compute[75026]:   <name>instance-00000032</name>
Nov 10 20:12:41 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 20:12:41 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 20:12:41 user nova-compute[75026]:   <metadata>
Nov 10 20:12:41 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 20:12:41 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 20:12:41 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeTestJSON-server-256599166</nova:name>
Nov 10 20:12:41 user nova-compute[75026]:       <nova:creationTime>2023-11-10 20:12:40</nova:creationTime>
Nov 10 20:12:41 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 20:12:41 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 20:12:41 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 20:12:41 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 20:12:41 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 20:12:41 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 20:12:41 user nova-compute[75026]:       </nova:flavor>
Nov 10 20:12:41 user nova-compute[75026]:       <nova:owner>
Nov 10 20:12:41 user nova-compute[75026]:         <nova:user uuid="3982ce75922144be8381f6dc9ee3f706">tempest-AttachVolumeTestJSON-636130646-project-member</nova:user>
Nov 10 20:12:41 user nova-compute[75026]:         <nova:project uuid="ab34f478806f4280892268b11c3da88a">tempest-AttachVolumeTestJSON-636130646</nova:project>
Nov 10 20:12:41 user nova-compute[75026]:       </nova:owner>
Nov 10 20:12:41 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 20:12:41 user nova-compute[75026]:       <nova:ports>
Nov 10 20:12:41 user nova-compute[75026]:         <nova:port uuid="ccb605a1-ff54-441d-88b8-e09107cd24c8">
Nov 10 20:12:41 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 20:12:41 user nova-compute[75026]:         </nova:port>
Nov 10 20:12:41 user nova-compute[75026]:       </nova:ports>
Nov 10 20:12:41 user nova-compute[75026]:     </nova:instance>
Nov 10 20:12:41 user nova-compute[75026]:   </metadata>
Nov 10 20:12:41 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 20:12:41 user nova-compute[75026]:     <system>
Nov 10 20:12:41 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 20:12:41 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 20:12:41 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 20:12:41 user nova-compute[75026]:       <entry name="serial">fc3e47bb-477e-416a-9183-c84ac841ac48</entry>
Nov 10 20:12:41 user nova-compute[75026]:       <entry name="uuid">fc3e47bb-477e-416a-9183-c84ac841ac48</entry>
Nov 10 20:12:41 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 20:12:41 user nova-compute[75026]:     </system>
Nov 10 20:12:41 user nova-compute[75026]:   </sysinfo>
Nov 10 20:12:41 user nova-compute[75026]:   <os>
Nov 10 20:12:41 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 20:12:41 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 20:12:41 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 20:12:41 user nova-compute[75026]:   </os>
Nov 10 20:12:41 user nova-compute[75026]:   <features>
Nov 10 20:12:41 user nova-compute[75026]:     <acpi/>
Nov 10 20:12:41 user nova-compute[75026]:     <apic/>
Nov 10 20:12:41 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 20:12:41 user nova-compute[75026]:   </features>
Nov 10 20:12:41 user nova-compute[75026]:   <clock offset="utc">
Nov 10 20:12:41 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 20:12:41 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 20:12:41 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 20:12:41 user nova-compute[75026]:   </clock>
Nov 10 20:12:41 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 20:12:41 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 20:12:41 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 20:12:41 user nova-compute[75026]:   </cpu>
Nov 10 20:12:41 user nova-compute[75026]:   <devices>
Nov 10 20:12:41 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 20:12:41 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 20:12:41 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk"/>
Nov 10 20:12:41 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 20:12:41 user nova-compute[75026]:     </disk>
Nov 10 20:12:41 user nova-compute[75026]:     <disk type="block" device="disk">
Nov 10 20:12:41 user nova-compute[75026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:12:41 user nova-compute[75026]:       <source dev="/dev/sdb"/>
Nov 10 20:12:41 user nova-compute[75026]:       <target dev="vdb" bus="virtio"/>
Nov 10 20:12:41 user nova-compute[75026]:       <serial>19c5d66e-cf11-4915-8130-0bec88f1c137</serial>
Nov 10 20:12:41 user nova-compute[75026]:     </disk>
Nov 10 20:12:41 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 20:12:41 user nova-compute[75026]:       <mac address="fa:16:3e:b8:20:90"/>
Nov 10 20:12:41 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:12:41 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 20:12:41 user nova-compute[75026]:       <target dev="tapccb605a1-ff"/>
Nov 10 20:12:41 user nova-compute[75026]:     </interface>
Nov 10 20:12:41 user nova-compute[75026]:     <serial type="pty">
Nov 10 20:12:41 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/console.log" append="off"/>
Nov 10 20:12:41 user nova-compute[75026]:     </serial>
Nov 10 20:12:41 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 20:12:41 user nova-compute[75026]:     <video>
Nov 10 20:12:41 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:12:41 user nova-compute[75026]:     </video>
Nov 10 20:12:41 user nova-compute[75026]:     <rng model="virtio">
Nov 10 20:12:41 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 20:12:41 user nova-compute[75026]:     </rng>
Nov 10 20:12:41 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 20:12:41 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 20:12:41 user nova-compute[75026]:       <stats period="10"/>
Nov 10 20:12:41 user nova-compute[75026]:     </memballoon>
Nov 10 20:12:41 user nova-compute[75026]:   </devices>
Nov 10 20:12:41 user nova-compute[75026]: </domain>
Nov 10 20:12:41 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:41 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.objects.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.167s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Cannot resize image /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.objects.instance [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'migration_context' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.objects.base [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T20:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG os_vif [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '013b3b09-baed-5978-badf-4b300d79ab2d', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccb605a1-ff, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccb605a1-ff, col_values=(('qos', UUID('9aec8c17-f497-42ec-8556-68c73f05fae4')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccb605a1-ff, col_values=(('external_ids', {'iface-id': 'ccb605a1-ff54-441d-88b8-e09107cd24c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:20:90', 'vm-uuid': 'fc3e47bb-477e-416a-9183-c84ac841ac48'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:42 user nova-compute[75026]: INFO os_vif [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff')
Nov 10 20:12:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:43 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-b5e60f1f-e1b4-4bb4-8816-d23ab3251147 req-cf8b8283-edb2-4567-a04c-b408a9d9ba16 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:12:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b5e60f1f-e1b4-4bb4-8816-d23ab3251147 req-cf8b8283-edb2-4567-a04c-b408a9d9ba16 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:12:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b5e60f1f-e1b4-4bb4-8816-d23ab3251147 req-cf8b8283-edb2-4567-a04c-b408a9d9ba16 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:12:43 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b5e60f1f-e1b4-4bb4-8816-d23ab3251147 req-cf8b8283-edb2-4567-a04c-b408a9d9ba16 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:12:43 user nova-compute[75026]: DEBUG nova.compute.manager [req-b5e60f1f-e1b4-4bb4-8816-d23ab3251147 req-cf8b8283-edb2-4567-a04c-b408a9d9ba16 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:12:43 user nova-compute[75026]: WARNING nova.compute.manager [req-b5e60f1f-e1b4-4bb4-8816-d23ab3251147 req-cf8b8283-edb2-4567-a04c-b408a9d9ba16 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state stopped and task_state powering-on.
Nov 10 20:12:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:45 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:12:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:12:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:12:45 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:12:45 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:12:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:12:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 20:12:45 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance rebooted successfully.
Nov 10 20:12:45 user nova-compute[75026]: DEBUG nova.compute.manager [None req-ebc2e006-4c52-4c4d-93bd-b0a57f8f7fa8 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:12:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-26d93ffd-4dd0-48f6-939e-7d8fb49fd44d req-f38efcb2-b4cc-49a4-b174-d154c71b721d service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:12:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26d93ffd-4dd0-48f6-939e-7d8fb49fd44d req-f38efcb2-b4cc-49a4-b174-d154c71b721d service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:12:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26d93ffd-4dd0-48f6-939e-7d8fb49fd44d req-f38efcb2-b4cc-49a4-b174-d154c71b721d service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:12:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-26d93ffd-4dd0-48f6-939e-7d8fb49fd44d req-f38efcb2-b4cc-49a4-b174-d154c71b721d service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:12:46 user nova-compute[75026]: DEBUG nova.compute.manager [req-26d93ffd-4dd0-48f6-939e-7d8fb49fd44d req-f38efcb2-b4cc-49a4-b174-d154c71b721d service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:12:46 user nova-compute[75026]: WARNING nova.compute.manager [req-26d93ffd-4dd0-48f6-939e-7d8fb49fd44d req-f38efcb2-b4cc-49a4-b174-d154c71b721d service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state active and task_state None.
Nov 10 20:12:46 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:12:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:12:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:12:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:48 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:12:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:12:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:12:50 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:12:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:12:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:12:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:12:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:12:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:12:51 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.14670181274414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:12:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:12:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:12:52 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:12:52 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:12:52 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:12:52 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:12:52 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:12:52 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:12:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:12:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:12:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:12:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:12:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:12:59 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:26 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 20:13:26 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 20:13:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:13:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:13:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:13:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:13:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:13:34 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:34 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 20:13:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:13:41 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:13:46 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:13:46 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:13:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:13:46 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:13:46 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:13:46 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:13:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:49 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:13:52 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 20:13:53 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:13:53 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.14592742919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:13:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:13:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:13:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:13:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:14:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:14:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:03 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Triggering sync for uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 20:14:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:14:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:14:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:14:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:14:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:14:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:14:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:14:30 user nova-compute[75026]: INFO nova.compute.manager [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Detaching volume 19c5d66e-cf11-4915-8130-0bec88f1c137
Nov 10 20:14:31 user nova-compute[75026]: INFO nova.virt.block_device [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Attempting to driver detach volume 19c5d66e-cf11-4915-8130-0bec88f1c137 from mountpoint /dev/vdb
Nov 10 20:14:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Attempting to detach device vdb from instance fc3e47bb-477e-416a-9183-c84ac841ac48 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 20:14:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 20:14:31 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:14:31 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:14:31 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:14:31 user nova-compute[75026]:   <serial>19c5d66e-cf11-4915-8130-0bec88f1c137</serial>
Nov 10 20:14:31 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 20:14:31 user nova-compute[75026]: </disk>
Nov 10 20:14:31 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 20:14:31 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully detached device vdb from instance fc3e47bb-477e-416a-9183-c84ac841ac48 from the persistent domain config.
Nov 10 20:14:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc3e47bb-477e-416a-9183-c84ac841ac48 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 20:14:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 20:14:31 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:14:31 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:14:31 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:14:31 user nova-compute[75026]:   <serial>19c5d66e-cf11-4915-8130-0bec88f1c137</serial>
Nov 10 20:14:31 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 20:14:31 user nova-compute[75026]: </disk>
Nov 10 20:14:31 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 20:14:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 20:14:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:14:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:34 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:14:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:14:47 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:14:48 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:14:48 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:14:48 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:14:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:51 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc3e47bb-477e-416a-9183-c84ac841ac48 is timed out.
Nov 10 20:14:51 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully detached device vdb from instance fc3e47bb-477e-416a-9183-c84ac841ac48 from the live domain config.
Nov 10 20:14:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CROpouIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:14:51 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6868168-0e81-4702-8fe3-6d2c83d2f67b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 20:14:51 user nova-compute[75026]: No targets found.
Nov 10 20:14:51 user nova-compute[75026]: iSNS:
Nov 10 20:14:51 user nova-compute[75026]: No targets found.
Nov 10 20:14:51 user nova-compute[75026]: STATIC:
Nov 10 20:14:51 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137
Nov 10 20:14:51 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 20:14:51 user nova-compute[75026]:                 Iface Name: default
Nov 10 20:14:51 user nova-compute[75026]: FIRMWARE:
Nov 10 20:14:51 user nova-compute[75026]: No targets found.
Nov 10 20:14:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 20:14:51 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 20:14:51 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[014febf7-83d3-49ff-a9b9-fd7a9d192938]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[33336706-6855-4350-9f82-c2da890e023a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)
Nov 10 20:14:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 (non-flash)
Nov 10 20:14:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed803bc820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8b4318-7ea2-400e-a914-c55258d5d9ea]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b977dd5f-6a2c-4998-aaee-32de5c71f73b]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff2da27-a038-448b-8138-9976484827b4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6789c4-22a5-4e80-9d6e-eb2c4776ce33]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19994be-c2cf-4792-a211-0e30cc92cff4]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee15bf7d-7f05-4a3f-b085-9f4a5b284e84]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260]
Nov 10 20:14:51 user nova-compute[75026]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137, portal: 172.16.0.220,3260] successful.
Nov 10 20:14:51 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c5d66e-cf11-4915-8130-0bec88f1c137 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74de588d-a63d-411f-a1e4-9623dbce83bd]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== disconnect_volume: return (291ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:14:51 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 20:14:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:14:52 user nova-compute[75026]: DEBUG nova.objects.instance [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:14:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-135ff873-deea-4454-8ad8-7edf37cd17b1 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.956s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0191be0d-41e3-4bc5-a1c0-e8a0084cc4d0 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0191be0d-41e3-4bc5-a1c0-e8a0084cc4d0 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0191be0d-41e3-4bc5-a1c0-e8a0084cc4d0 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0191be0d-41e3-4bc5-a1c0-e8a0084cc4d0 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75026) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG nova.objects.instance [None req-0191be0d-41e3-4bc5-a1c0-e8a0084cc4d0 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-b0157064-5112-4b14-94d5-146145100ed0 req-6e176fff-1b21-4ed8-8e19-375eb33c16a2 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b0157064-5112-4b14-94d5-146145100ed0 req-6e176fff-1b21-4ed8-8e19-375eb33c16a2 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b0157064-5112-4b14-94d5-146145100ed0 req-6e176fff-1b21-4ed8-8e19-375eb33c16a2 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b0157064-5112-4b14-94d5-146145100ed0 req-6e176fff-1b21-4ed8-8e19-375eb33c16a2 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG nova.compute.manager [req-b0157064-5112-4b14-94d5-146145100ed0 req-6e176fff-1b21-4ed8-8e19-375eb33c16a2 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:14:53 user nova-compute[75026]: WARNING nova.compute.manager [req-b0157064-5112-4b14-94d5-146145100ed0 req-6e176fff-1b21-4ed8-8e19-375eb33c16a2 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state active and task_state powering-off.
Nov 10 20:14:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:53 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:54 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance destroyed successfully.
Nov 10 20:14:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-0191be0d-41e3-4bc5-a1c0-e8a0084cc4d0 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:14:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-0191be0d-41e3-4bc5-a1c0-e8a0084cc4d0 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.855s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:14:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:14:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:14:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:14:54 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:14:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:14:55 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:14:55 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=25.14507293701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-27ff3d73-c563-4cad-946c-be9963605eaf req-b8f7fed6-e7dd-4186-aae1-421180d78808 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-27ff3d73-c563-4cad-946c-be9963605eaf req-b8f7fed6-e7dd-4186-aae1-421180d78808 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-27ff3d73-c563-4cad-946c-be9963605eaf req-b8f7fed6-e7dd-4186-aae1-421180d78808 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-27ff3d73-c563-4cad-946c-be9963605eaf req-b8f7fed6-e7dd-4186-aae1-421180d78808 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.compute.manager [req-27ff3d73-c563-4cad-946c-be9963605eaf req-b8f7fed6-e7dd-4186-aae1-421180d78808 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:14:55 user nova-compute[75026]: WARNING nova.compute.manager [req-27ff3d73-c563-4cad-946c-be9963605eaf req-b8f7fed6-e7dd-4186-aae1-421180d78808 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state stopped and task_state None.
Nov 10 20:14:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:14:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:14:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:14:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:14:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:15:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:15:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:15:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:15:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:15:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:15:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:15:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:15:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:15:49 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:15:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:15:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:15:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:15:49 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:15:49 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:15:50 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:15:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:15:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:15:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:15:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:15:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:52 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:15:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:15:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:15:54 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:15:54 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:15:55 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:15:55 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:15:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9117MB free_disk=25.144512176513672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:15:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:15:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:15:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:15:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:15:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:15:57 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:15:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:15:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:16:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:02 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:16:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:07 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:16:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:12 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:17 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:22 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:27 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:32 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:37 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:42 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.base [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.network.neutron [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:16:44 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance destroyed successfully.
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'resources' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.base [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T20:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG os_vif [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccb605a1-ff, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9aec8c17-f497-42ec-8556-68c73f05fae4) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:44 user nova-compute[75026]: INFO os_vif [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff')
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Start _get_guest_xml network_info=[{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'numa_topology' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.base [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:16:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:16:44 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.base [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T20:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:16:44 user nova-compute[75026]: DEBUG nova.objects.instance [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'pci_devices' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.objects.base [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] End _get_guest_xml xml=<domain type="kvm">
Nov 10 20:16:45 user nova-compute[75026]:   <uuid>fc3e47bb-477e-416a-9183-c84ac841ac48</uuid>
Nov 10 20:16:45 user nova-compute[75026]:   <name>instance-00000032</name>
Nov 10 20:16:45 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 20:16:45 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 20:16:45 user nova-compute[75026]:   <metadata>
Nov 10 20:16:45 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 20:16:45 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 20:16:45 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeTestJSON-server-256599166</nova:name>
Nov 10 20:16:45 user nova-compute[75026]:       <nova:creationTime>2023-11-10 20:16:44</nova:creationTime>
Nov 10 20:16:45 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 20:16:45 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 20:16:45 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 20:16:45 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 20:16:45 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 20:16:45 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 20:16:45 user nova-compute[75026]:       </nova:flavor>
Nov 10 20:16:45 user nova-compute[75026]:       <nova:owner>
Nov 10 20:16:45 user nova-compute[75026]:         <nova:user uuid="3982ce75922144be8381f6dc9ee3f706">tempest-AttachVolumeTestJSON-636130646-project-member</nova:user>
Nov 10 20:16:45 user nova-compute[75026]:         <nova:project uuid="ab34f478806f4280892268b11c3da88a">tempest-AttachVolumeTestJSON-636130646</nova:project>
Nov 10 20:16:45 user nova-compute[75026]:       </nova:owner>
Nov 10 20:16:45 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 20:16:45 user nova-compute[75026]:       <nova:ports>
Nov 10 20:16:45 user nova-compute[75026]:         <nova:port uuid="ccb605a1-ff54-441d-88b8-e09107cd24c8">
Nov 10 20:16:45 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 20:16:45 user nova-compute[75026]:         </nova:port>
Nov 10 20:16:45 user nova-compute[75026]:       </nova:ports>
Nov 10 20:16:45 user nova-compute[75026]:     </nova:instance>
Nov 10 20:16:45 user nova-compute[75026]:   </metadata>
Nov 10 20:16:45 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 20:16:45 user nova-compute[75026]:     <system>
Nov 10 20:16:45 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 20:16:45 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 20:16:45 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 20:16:45 user nova-compute[75026]:       <entry name="serial">fc3e47bb-477e-416a-9183-c84ac841ac48</entry>
Nov 10 20:16:45 user nova-compute[75026]:       <entry name="uuid">fc3e47bb-477e-416a-9183-c84ac841ac48</entry>
Nov 10 20:16:45 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 20:16:45 user nova-compute[75026]:     </system>
Nov 10 20:16:45 user nova-compute[75026]:   </sysinfo>
Nov 10 20:16:45 user nova-compute[75026]:   <os>
Nov 10 20:16:45 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 20:16:45 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 20:16:45 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 20:16:45 user nova-compute[75026]:   </os>
Nov 10 20:16:45 user nova-compute[75026]:   <features>
Nov 10 20:16:45 user nova-compute[75026]:     <acpi/>
Nov 10 20:16:45 user nova-compute[75026]:     <apic/>
Nov 10 20:16:45 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 20:16:45 user nova-compute[75026]:   </features>
Nov 10 20:16:45 user nova-compute[75026]:   <clock offset="utc">
Nov 10 20:16:45 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 20:16:45 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 20:16:45 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 20:16:45 user nova-compute[75026]:   </clock>
Nov 10 20:16:45 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 20:16:45 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 20:16:45 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 20:16:45 user nova-compute[75026]:   </cpu>
Nov 10 20:16:45 user nova-compute[75026]:   <devices>
Nov 10 20:16:45 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 20:16:45 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 20:16:45 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk"/>
Nov 10 20:16:45 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 20:16:45 user nova-compute[75026]:     </disk>
Nov 10 20:16:45 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 20:16:45 user nova-compute[75026]:       <mac address="fa:16:3e:b8:20:90"/>
Nov 10 20:16:45 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:16:45 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 20:16:45 user nova-compute[75026]:       <target dev="tapccb605a1-ff"/>
Nov 10 20:16:45 user nova-compute[75026]:     </interface>
Nov 10 20:16:45 user nova-compute[75026]:     <serial type="pty">
Nov 10 20:16:45 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/console.log" append="off"/>
Nov 10 20:16:45 user nova-compute[75026]:     </serial>
Nov 10 20:16:45 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 20:16:45 user nova-compute[75026]:     <video>
Nov 10 20:16:45 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:16:45 user nova-compute[75026]:     </video>
Nov 10 20:16:45 user nova-compute[75026]:     <rng model="virtio">
Nov 10 20:16:45 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 20:16:45 user nova-compute[75026]:     </rng>
Nov 10 20:16:45 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 20:16:45 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 20:16:45 user nova-compute[75026]:       <stats period="10"/>
Nov 10 20:16:45 user nova-compute[75026]:     </memballoon>
Nov 10 20:16:45 user nova-compute[75026]:   </devices>
Nov 10 20:16:45 user nova-compute[75026]: </domain>
Nov 10 20:16:45 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.objects.base [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Cannot resize image /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.objects.instance [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'migration_context' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.objects.base [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Object Instance<fc3e47bb-477e-416a-9183-c84ac841ac48> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75026) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T20:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG os_vif [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '013b3b09-baed-5978-badf-4b300d79ab2d', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccb605a1-ff, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccb605a1-ff, col_values=(('qos', UUID('147d5376-f08f-4b15-a250-a862b6657dd2')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccb605a1-ff, col_values=(('external_ids', {'iface-id': 'ccb605a1-ff54-441d-88b8-e09107cd24c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:20:90', 'vm-uuid': 'fc3e47bb-477e-416a-9183-c84ac841ac48'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:45 user nova-compute[75026]: INFO os_vif [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff')
Nov 10 20:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b4d59c47-48f3-42fd-83c3-f2926fec1961 req-6f9e4ff7-ce64-4b7f-ae2f-3d50dd0bb897 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b4d59c47-48f3-42fd-83c3-f2926fec1961 req-6f9e4ff7-ce64-4b7f-ae2f-3d50dd0bb897 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b4d59c47-48f3-42fd-83c3-f2926fec1961 req-6f9e4ff7-ce64-4b7f-ae2f-3d50dd0bb897 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-b4d59c47-48f3-42fd-83c3-f2926fec1961 req-6f9e4ff7-ce64-4b7f-ae2f-3d50dd0bb897 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG nova.compute.manager [req-b4d59c47-48f3-42fd-83c3-f2926fec1961 req-6f9e4ff7-ce64-4b7f-ae2f-3d50dd0bb897 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:16:47 user nova-compute[75026]: WARNING nova.compute.manager [req-b4d59c47-48f3-42fd-83c3-f2926fec1961 req-6f9e4ff7-ce64-4b7f-ae2f-3d50dd0bb897 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state stopped and task_state powering-on.
Nov 10 20:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:47 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 20:16:49 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance rebooted successfully.
Nov 10 20:16:49 user nova-compute[75026]: DEBUG nova.compute.manager [None req-de072487-4f9a-4486-8896-95b762c5b974 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:16:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-6320b46e-c635-425c-8367-517332aece7a req-7826d30f-6943-4eea-9788-e4a1ffb985fa service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:16:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6320b46e-c635-425c-8367-517332aece7a req-7826d30f-6943-4eea-9788-e4a1ffb985fa service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:16:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6320b46e-c635-425c-8367-517332aece7a req-7826d30f-6943-4eea-9788-e4a1ffb985fa service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:16:49 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-6320b46e-c635-425c-8367-517332aece7a req-7826d30f-6943-4eea-9788-e4a1ffb985fa service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:16:49 user nova-compute[75026]: DEBUG nova.compute.manager [req-6320b46e-c635-425c-8367-517332aece7a req-7826d30f-6943-4eea-9788-e4a1ffb985fa service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:16:49 user nova-compute[75026]: WARNING nova.compute.manager [req-6320b46e-c635-425c-8367-517332aece7a req-7826d30f-6943-4eea-9788-e4a1ffb985fa service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state active and task_state None.
Nov 10 20:16:49 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:50 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:16:50 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:16:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:16:50 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:16:50 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:16:50 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:16:51 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:16:51 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:16:51 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:16:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:16:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:16:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:16:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:16:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:16:56 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:16:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:16:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:16:57 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:16:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.143299102783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:16:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:16:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:16:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:17:04 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:09 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:14 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:19 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:17:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:17:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:17:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:17:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:17:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:17:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:17:52 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:17:52 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:17:52 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:17:53 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [{"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:17:53 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-fc3e47bb-477e-416a-9183-c84ac841ac48" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:17:53 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:17:53 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:17:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:17:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:17:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:17:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:17:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:17:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:17:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:17:57 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:17:58 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:17:58 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:17:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8980MB free_disk=25.126907348632812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance fc3e47bb-477e-416a-9183-c84ac841ac48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:17:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:17:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:17:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:18:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:04 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:18:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:18:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:18:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:18:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:18:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:18:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:18:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:18:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:18:10 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:15 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:18:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:18:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:18:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:18:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:18:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:18:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:18:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:18:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:30 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 20:18:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 20:18:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:18:35 user nova-compute[75026]: INFO nova.compute.manager [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Terminating instance
Nov 10 20:18:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-2a3efcbb-7dff-4011-be4a-8372009fedde req-d45b8a53-b71e-4012-8e76-f419e9af834a service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2a3efcbb-7dff-4011-be4a-8372009fedde req-d45b8a53-b71e-4012-8e76-f419e9af834a service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2a3efcbb-7dff-4011-be4a-8372009fedde req-d45b8a53-b71e-4012-8e76-f419e9af834a service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-2a3efcbb-7dff-4011-be4a-8372009fedde req-d45b8a53-b71e-4012-8e76-f419e9af834a service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-2a3efcbb-7dff-4011-be4a-8372009fedde req-d45b8a53-b71e-4012-8e76-f419e9af834a service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.compute.manager [req-2a3efcbb-7dff-4011-be4a-8372009fedde req-d45b8a53-b71e-4012-8e76-f419e9af834a service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-unplugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Instance destroyed successfully.
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.objects.instance [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'resources' on Instance uuid fc3e47bb-477e-416a-9183-c84ac841ac48 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-256599166',display_name='tempest-AttachVolumeTestJSON-server-256599166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-256599166',id=50,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFloAT9TXse/bHAkuPCAkqnQvnDihkVd4sE0KopltodFiBg0UNCUjNMwouNpbordwY9xJfyPTmPindvxmEhJ8PoUxokHDbFMwBJbRiDGLj6sazrWmjZS3PrAMqtIE7qt8Q==',key_name='tempest-keypair-153693546',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-1szyeihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T20:16:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=fc3e47bb-477e-416a-9183-c84ac841ac48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "address": "fa:16:3e:b8:20:90", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb605a1-ff", "ovs_interfaceid": "ccb605a1-ff54-441d-88b8-e09107cd24c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG os_vif [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccb605a1-ff, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=147d5376-f08f-4b15-a250-a862b6657dd2) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:36 user nova-compute[75026]: INFO os_vif [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:20:90,bridge_name='br-int',has_traffic_filtering=True,id=ccb605a1-ff54-441d-88b8-e09107cd24c8,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb605a1-ff')
Nov 10 20:18:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Deleting instance files /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48_del
Nov 10 20:18:36 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Deletion of /opt/stack/data/nova/instances/fc3e47bb-477e-416a-9183-c84ac841ac48_del complete
Nov 10 20:18:36 user nova-compute[75026]: INFO nova.compute.manager [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 20:18:36 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:18:36 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:18:37 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:18:37 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Took 0.72 seconds to deallocate network for instance.
Nov 10 20:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:18:37 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:18:37 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:18:37 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Deleted allocations for instance fc3e47bb-477e-416a-9183-c84ac841ac48
Nov 10 20:18:37 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-e9b8b7be-a02e-4e9b-846b-47ced73487c7 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.029s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:18:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-74ef3fdd-69db-4cb5-a1e8-82fd9f7b47f7 req-6a145f7b-6f51-44b3-813c-3b3ee24f8727 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-74ef3fdd-69db-4cb5-a1e8-82fd9f7b47f7 req-6a145f7b-6f51-44b3-813c-3b3ee24f8727 service nova] Acquiring lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-74ef3fdd-69db-4cb5-a1e8-82fd9f7b47f7 req-6a145f7b-6f51-44b3-813c-3b3ee24f8727 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:18:38 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-74ef3fdd-69db-4cb5-a1e8-82fd9f7b47f7 req-6a145f7b-6f51-44b3-813c-3b3ee24f8727 service nova] Lock "fc3e47bb-477e-416a-9183-c84ac841ac48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:18:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-74ef3fdd-69db-4cb5-a1e8-82fd9f7b47f7 req-6a145f7b-6f51-44b3-813c-3b3ee24f8727 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] No waiting events found dispatching network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:18:38 user nova-compute[75026]: WARNING nova.compute.manager [req-74ef3fdd-69db-4cb5-a1e8-82fd9f7b47f7 req-6a145f7b-6f51-44b3-813c-3b3ee24f8727 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received unexpected event network-vif-plugged-ccb605a1-ff54-441d-88b8-e09107cd24c8 for instance with vm_state deleted and task_state None.
Nov 10 20:18:38 user nova-compute[75026]: DEBUG nova.compute.manager [req-74ef3fdd-69db-4cb5-a1e8-82fd9f7b47f7 req-6a145f7b-6f51-44b3-813c-3b3ee24f8727 service nova] [instance: fc3e47bb-477e-416a-9183-c84ac841ac48] Received event network-vif-deleted-ccb605a1-ff54-441d-88b8-e09107cd24c8 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:18:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:47 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:47 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 20:18:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:51 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:52 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:18:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:18:52 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 20:18:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:18:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:18:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:18:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:18:57 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:18:58 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:18:58 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9113MB free_disk=25.154438018798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:18:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:18:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:18:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:19:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:19:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:19:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Starting instance... {{(pid=75026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 20:19:29 user nova-compute[75026]: INFO nova.compute.claims [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Claim successful on node user
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Start building networks asynchronously for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Allocating IP information in the background. {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] allocate_for_instance() {{(pid=75026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 20:19:29 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Start building block device mappings for instance. {{(pid=75026) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 20:19:29 user nova-compute[75026]: DEBUG nova.policy [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3982ce75922144be8381f6dc9ee3f706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab34f478806f4280892268b11c3da88a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75026) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Start spawning the instance on the hypervisor. {{(pid=75026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Creating instance directory {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 20:19:30 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Creating image(s)
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "/opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "/opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "/opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.178s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk 1073741824 {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd,backing_fmt=raw /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk 1073741824" returned: 0 in 0.055s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "5d11e5e638bf2a7e50dbec3264137c01ca9509dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Successfully created port: 1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d11e5e638bf2a7e50dbec3264137c01ca9509dd --force-share --output=json" returned: 0 in 0.179s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk. size=1073741824 {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG nova.virt.disk.api [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Cannot resize image /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk to a smaller size. {{(pid=75026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Created local disks {{(pid=75026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Ensure instance console log exists: /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/console.log {{(pid=75026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:30 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Successfully updated port: 1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquired lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Building network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9bcff280-630e-4e99-a6fb-7d44f0e25c4a req-9ba13f73-9a50-4015-b1fa-991377bc03e8 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received event network-changed-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.compute.manager [req-9bcff280-630e-4e99-a6fb-7d44f0e25c4a req-9ba13f73-9a50-4015-b1fa-991377bc03e8 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Refreshing instance network info cache due to event network-changed-1c82ec2f-6594-4a24-980a-a42d262ec795. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9bcff280-630e-4e99-a6fb-7d44f0e25c4a req-9ba13f73-9a50-4015-b1fa-991377bc03e8 service nova] Acquiring lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Instance cache missing network info. {{(pid=75026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.neutron [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating instance_info_cache with network_info: [{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Releasing lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Instance network_info: |[{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9bcff280-630e-4e99-a6fb-7d44f0e25c4a req-9ba13f73-9a50-4015-b1fa-991377bc03e8 service nova] Acquired lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.neutron [req-9bcff280-630e-4e99-a6fb-7d44f0e25c4a req-9ba13f73-9a50-4015-b1fa-991377bc03e8 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Refreshing network info cache for port 1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Start _get_guest_xml network_info=[{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'da817026-309f-4431-a8d4-b6d8e64853b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 20:19:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:19:31 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU controller missing on host. {{(pid=75026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.host [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU controller found on host. {{(pid=75026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T19:12:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T19:12:25Z,direct_url=<?>,disk_format='qcow2',id=da817026-309f-4431-a8d4-b6d8e64853b2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9f10d948577b407181ab3af2309a1703',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T19:12:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flavor limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Image limits 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flavor pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Image pref 0:0:0 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Got 1 possible topologies {{(pid=75026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.hardware [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-194785027',display_name='tempest-AttachVolumeTestJSON-server-194785027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-194785027',id=51,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwkoWfcs/wzNq7ku2N7i9GJOhLvqOkcQfb3JQT3leGNpPjP2SG8fQpD+1RLSVr+iy4CHOZkgIe2qy++Em5VDpMQZd158REa18bdD0JlSLNWGYaa+wx8n53eCjLV8My7ow==',key_name='tempest-keypair-2001661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-camypv7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T20:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=922dcedc-1089-4a99-a3b5-0114c184f799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=1c82ec2f-6594-4a24-980a-a42d262ec795,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c82ec2f-65') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'pci_devices' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] End _get_guest_xml xml=<domain type="kvm">
Nov 10 20:19:31 user nova-compute[75026]:   <uuid>922dcedc-1089-4a99-a3b5-0114c184f799</uuid>
Nov 10 20:19:31 user nova-compute[75026]:   <name>instance-00000033</name>
Nov 10 20:19:31 user nova-compute[75026]:   <memory>524288</memory>
Nov 10 20:19:31 user nova-compute[75026]:   <vcpu>1</vcpu>
Nov 10 20:19:31 user nova-compute[75026]:   <metadata>
Nov 10 20:19:31 user nova-compute[75026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 20:19:31 user nova-compute[75026]:       <nova:package version="0.0.0"/>
Nov 10 20:19:31 user nova-compute[75026]:       <nova:name>tempest-AttachVolumeTestJSON-server-194785027</nova:name>
Nov 10 20:19:31 user nova-compute[75026]:       <nova:creationTime>2023-11-10 20:19:31</nova:creationTime>
Nov 10 20:19:31 user nova-compute[75026]:       <nova:flavor name="m1.tiny">
Nov 10 20:19:31 user nova-compute[75026]:         <nova:memory>512</nova:memory>
Nov 10 20:19:31 user nova-compute[75026]:         <nova:disk>1</nova:disk>
Nov 10 20:19:31 user nova-compute[75026]:         <nova:swap>0</nova:swap>
Nov 10 20:19:31 user nova-compute[75026]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 20:19:31 user nova-compute[75026]:         <nova:vcpus>1</nova:vcpus>
Nov 10 20:19:31 user nova-compute[75026]:       </nova:flavor>
Nov 10 20:19:31 user nova-compute[75026]:       <nova:owner>
Nov 10 20:19:31 user nova-compute[75026]:         <nova:user uuid="3982ce75922144be8381f6dc9ee3f706">tempest-AttachVolumeTestJSON-636130646-project-member</nova:user>
Nov 10 20:19:31 user nova-compute[75026]:         <nova:project uuid="ab34f478806f4280892268b11c3da88a">tempest-AttachVolumeTestJSON-636130646</nova:project>
Nov 10 20:19:31 user nova-compute[75026]:       </nova:owner>
Nov 10 20:19:31 user nova-compute[75026]:       <nova:root type="image" uuid="da817026-309f-4431-a8d4-b6d8e64853b2"/>
Nov 10 20:19:31 user nova-compute[75026]:       <nova:ports>
Nov 10 20:19:31 user nova-compute[75026]:         <nova:port uuid="1c82ec2f-6594-4a24-980a-a42d262ec795">
Nov 10 20:19:31 user nova-compute[75026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 20:19:31 user nova-compute[75026]:         </nova:port>
Nov 10 20:19:31 user nova-compute[75026]:       </nova:ports>
Nov 10 20:19:31 user nova-compute[75026]:     </nova:instance>
Nov 10 20:19:31 user nova-compute[75026]:   </metadata>
Nov 10 20:19:31 user nova-compute[75026]:   <sysinfo type="smbios">
Nov 10 20:19:31 user nova-compute[75026]:     <system>
Nov 10 20:19:31 user nova-compute[75026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 20:19:31 user nova-compute[75026]:       <entry name="product">OpenStack Nova</entry>
Nov 10 20:19:31 user nova-compute[75026]:       <entry name="version">0.0.0</entry>
Nov 10 20:19:31 user nova-compute[75026]:       <entry name="serial">922dcedc-1089-4a99-a3b5-0114c184f799</entry>
Nov 10 20:19:31 user nova-compute[75026]:       <entry name="uuid">922dcedc-1089-4a99-a3b5-0114c184f799</entry>
Nov 10 20:19:31 user nova-compute[75026]:       <entry name="family">Virtual Machine</entry>
Nov 10 20:19:31 user nova-compute[75026]:     </system>
Nov 10 20:19:31 user nova-compute[75026]:   </sysinfo>
Nov 10 20:19:31 user nova-compute[75026]:   <os>
Nov 10 20:19:31 user nova-compute[75026]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 20:19:31 user nova-compute[75026]:     <boot dev="hd"/>
Nov 10 20:19:31 user nova-compute[75026]:     <smbios mode="sysinfo"/>
Nov 10 20:19:31 user nova-compute[75026]:   </os>
Nov 10 20:19:31 user nova-compute[75026]:   <features>
Nov 10 20:19:31 user nova-compute[75026]:     <acpi/>
Nov 10 20:19:31 user nova-compute[75026]:     <apic/>
Nov 10 20:19:31 user nova-compute[75026]:     <vmcoreinfo/>
Nov 10 20:19:31 user nova-compute[75026]:   </features>
Nov 10 20:19:31 user nova-compute[75026]:   <clock offset="utc">
Nov 10 20:19:31 user nova-compute[75026]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 20:19:31 user nova-compute[75026]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 20:19:31 user nova-compute[75026]:     <timer name="hpet" present="no"/>
Nov 10 20:19:31 user nova-compute[75026]:   </clock>
Nov 10 20:19:31 user nova-compute[75026]:   <cpu mode="custom" match="exact">
Nov 10 20:19:31 user nova-compute[75026]:     <model>Nehalem</model>
Nov 10 20:19:31 user nova-compute[75026]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 20:19:31 user nova-compute[75026]:   </cpu>
Nov 10 20:19:31 user nova-compute[75026]:   <devices>
Nov 10 20:19:31 user nova-compute[75026]:     <disk type="file" device="disk">
Nov 10 20:19:31 user nova-compute[75026]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 20:19:31 user nova-compute[75026]:       <source file="/opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk"/>
Nov 10 20:19:31 user nova-compute[75026]:       <target dev="vda" bus="virtio"/>
Nov 10 20:19:31 user nova-compute[75026]:     </disk>
Nov 10 20:19:31 user nova-compute[75026]:     <interface type="ethernet">
Nov 10 20:19:31 user nova-compute[75026]:       <mac address="fa:16:3e:6c:ab:44"/>
Nov 10 20:19:31 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:19:31 user nova-compute[75026]:       <mtu size="1442"/>
Nov 10 20:19:31 user nova-compute[75026]:       <target dev="tap1c82ec2f-65"/>
Nov 10 20:19:31 user nova-compute[75026]:     </interface>
Nov 10 20:19:31 user nova-compute[75026]:     <serial type="pty">
Nov 10 20:19:31 user nova-compute[75026]:       <log file="/opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/console.log" append="off"/>
Nov 10 20:19:31 user nova-compute[75026]:     </serial>
Nov 10 20:19:31 user nova-compute[75026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 20:19:31 user nova-compute[75026]:     <video>
Nov 10 20:19:31 user nova-compute[75026]:       <model type="virtio"/>
Nov 10 20:19:31 user nova-compute[75026]:     </video>
Nov 10 20:19:31 user nova-compute[75026]:     <rng model="virtio">
Nov 10 20:19:31 user nova-compute[75026]:       <backend model="random">/dev/urandom</backend>
Nov 10 20:19:31 user nova-compute[75026]:     </rng>
Nov 10 20:19:31 user nova-compute[75026]:     <controller type="usb" index="0" model="none"/>
Nov 10 20:19:31 user nova-compute[75026]:     <memballoon model="virtio">
Nov 10 20:19:31 user nova-compute[75026]:       <stats period="10"/>
Nov 10 20:19:31 user nova-compute[75026]:     </memballoon>
Nov 10 20:19:31 user nova-compute[75026]:   </devices>
Nov 10 20:19:31 user nova-compute[75026]: </domain>
Nov 10 20:19:31 user nova-compute[75026]:  {{(pid=75026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-194785027',display_name='tempest-AttachVolumeTestJSON-server-194785027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-194785027',id=51,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwkoWfcs/wzNq7ku2N7i9GJOhLvqOkcQfb3JQT3leGNpPjP2SG8fQpD+1RLSVr+iy4CHOZkgIe2qy++Em5VDpMQZd158REa18bdD0JlSLNWGYaa+wx8n53eCjLV8My7ow==',key_name='tempest-keypair-2001661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-camypv7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T20:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=922dcedc-1089-4a99-a3b5-0114c184f799,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=1c82ec2f-6594-4a24-980a-a42d262ec795,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c82ec2f-65') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG os_vif [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=1c82ec2f-6594-4a24-980a-a42d262ec795,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c82ec2f-65') {{(pid=75026) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fac4b0df-f267-50be-bea1-a4536cc37d84', '_type': 'linux-noop'}}, row=False) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c82ec2f-65, may_exist=True, interface_attrs={}) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c82ec2f-65, col_values=(('qos', UUID('e2d1bcde-5a7c-46fb-8fb5-295202b0709e')),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c82ec2f-65, col_values=(('external_ids', {'iface-id': '1c82ec2f-6594-4a24-980a-a42d262ec795', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:ab:44', 'vm-uuid': '922dcedc-1089-4a99-a3b5-0114c184f799'}),), if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:31 user nova-compute[75026]: INFO os_vif [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=1c82ec2f-6594-4a24-980a-a42d262ec795,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c82ec2f-65')
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:19:31 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No VIF found with MAC fa:16:3e:6c:ab:44, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 20:19:32 user nova-compute[75026]: DEBUG nova.network.neutron [req-9bcff280-630e-4e99-a6fb-7d44f0e25c4a req-9ba13f73-9a50-4015-b1fa-991377bc03e8 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updated VIF entry in instance network info cache for port 1c82ec2f-6594-4a24-980a-a42d262ec795. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:19:32 user nova-compute[75026]: DEBUG nova.network.neutron [req-9bcff280-630e-4e99-a6fb-7d44f0e25c4a req-9ba13f73-9a50-4015-b1fa-991377bc03e8 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating instance_info_cache with network_info: [{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:19:32 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-9bcff280-630e-4e99-a6fb-7d44f0e25c4a req-9ba13f73-9a50-4015-b1fa-991377bc03e8 service nova] Releasing lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-e05c5df0-f0f8-487d-9d46-e0a471f5d820 req-d0160f90-5aa2-41cd-b575-01fcc4c6d727 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received event network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e05c5df0-f0f8-487d-9d46-e0a471f5d820 req-d0160f90-5aa2-41cd-b575-01fcc4c6d727 service nova] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e05c5df0-f0f8-487d-9d46-e0a471f5d820 req-d0160f90-5aa2-41cd-b575-01fcc4c6d727 service nova] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-e05c5df0-f0f8-487d-9d46-e0a471f5d820 req-d0160f90-5aa2-41cd-b575-01fcc4c6d727 service nova] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG nova.compute.manager [req-e05c5df0-f0f8-487d-9d46-e0a471f5d820 req-d0160f90-5aa2-41cd-b575-01fcc4c6d727 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] No waiting events found dispatching network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:19:33 user nova-compute[75026]: WARNING nova.compute.manager [req-e05c5df0-f0f8-487d-9d46-e0a471f5d820 req-d0160f90-5aa2-41cd-b575-01fcc4c6d727 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received unexpected event network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 for instance with vm_state building and task_state spawning.
Nov 10 20:19:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:33 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Instance event wait completed in 0 seconds for  {{(pid=75026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Guest created on hypervisor {{(pid=75026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 20:19:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Instance spawned successfully.
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Found default for hw_cdrom_bus of ide {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Found default for hw_disk_bus of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Found default for hw_input_bus of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Found default for hw_pointer_model of None {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Found default for hw_video_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Found default for hw_vif_model of virtio {{(pid=75026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 20:19:35 user nova-compute[75026]: INFO nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Checking state {{(pid=75026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 20:19:35 user nova-compute[75026]: INFO nova.compute.manager [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Took 5.71 seconds to build instance.
Nov 10 20:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1aab9928-ad15-438b-b398-036a9b2b9762 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.811s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-7f2c1962-b0ad-405f-8947-c561d689deab req-5ac73a1b-dfd7-40dc-bc3a-8d77966fd160 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received event network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7f2c1962-b0ad-405f-8947-c561d689deab req-5ac73a1b-dfd7-40dc-bc3a-8d77966fd160 service nova] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7f2c1962-b0ad-405f-8947-c561d689deab req-5ac73a1b-dfd7-40dc-bc3a-8d77966fd160 service nova] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-7f2c1962-b0ad-405f-8947-c561d689deab req-5ac73a1b-dfd7-40dc-bc3a-8d77966fd160 service nova] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:19:35 user nova-compute[75026]: DEBUG nova.compute.manager [req-7f2c1962-b0ad-405f-8947-c561d689deab req-5ac73a1b-dfd7-40dc-bc3a-8d77966fd160 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] No waiting events found dispatching network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:19:35 user nova-compute[75026]: WARNING nova.compute.manager [req-7f2c1962-b0ad-405f-8947-c561d689deab req-5ac73a1b-dfd7-40dc-bc3a-8d77966fd160 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received unexpected event network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 for instance with vm_state active and task_state None.
Nov 10 20:19:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:19:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:19:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:19:54 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:19:54 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:19:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:55 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating instance_info_cache with network_info: [{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:19:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:19:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:19:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:19:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:19:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:19:58 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:19:58 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:19:59 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:19:59 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:19:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=25.124832153320312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 922dcedc-1089-4a99-a3b5-0114c184f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:19:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:20:00 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:05 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:20:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:20:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:20:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:20:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:20:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:20:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:20:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:20:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:20:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:20:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:20:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:20:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:20:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:20:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:20:54 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:20:54 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:20:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:20:54 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:20:54 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:20:54 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:20:55 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating instance_info_cache with network_info: [{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:20:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:20:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:20:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:20:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:20:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:20:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:20:59 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:20:59 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:20:59 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:21:00 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:21:00 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:21:00 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=25.124099731445312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 922dcedc-1089-4a99-a3b5-0114c184f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:21:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:21:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:21:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:21:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:21:03 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:21:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:21:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:21:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:21:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:21:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:21:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:21:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:21:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:21:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:21:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-f3454c45-a130-421e-b04b-2bb90d09b9b5 req-a339789b-49f9-4069-b4c7-40b0a109bf76 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received event network-changed-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:21:20 user nova-compute[75026]: DEBUG nova.compute.manager [req-f3454c45-a130-421e-b04b-2bb90d09b9b5 req-a339789b-49f9-4069-b4c7-40b0a109bf76 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Refreshing instance network info cache due to event network-changed-1c82ec2f-6594-4a24-980a-a42d262ec795. {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 20:21:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3454c45-a130-421e-b04b-2bb90d09b9b5 req-a339789b-49f9-4069-b4c7-40b0a109bf76 service nova] Acquiring lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:21:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3454c45-a130-421e-b04b-2bb90d09b9b5 req-a339789b-49f9-4069-b4c7-40b0a109bf76 service nova] Acquired lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:21:20 user nova-compute[75026]: DEBUG nova.network.neutron [req-f3454c45-a130-421e-b04b-2bb90d09b9b5 req-a339789b-49f9-4069-b4c7-40b0a109bf76 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Refreshing network info cache for port 1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 20:21:21 user nova-compute[75026]: DEBUG nova.network.neutron [req-f3454c45-a130-421e-b04b-2bb90d09b9b5 req-a339789b-49f9-4069-b4c7-40b0a109bf76 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updated VIF entry in instance network info cache for port 1c82ec2f-6594-4a24-980a-a42d262ec795. {{(pid=75026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 20:21:21 user nova-compute[75026]: DEBUG nova.network.neutron [req-f3454c45-a130-421e-b04b-2bb90d09b9b5 req-a339789b-49f9-4069-b4c7-40b0a109bf76 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating instance_info_cache with network_info: [{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:21:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-f3454c45-a130-421e-b04b-2bb90d09b9b5 req-a339789b-49f9-4069-b4c7-40b0a109bf76 service nova] Releasing lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:21:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:25 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:21:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:21:26 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:21:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:21:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:21:26 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:21:26 user nova-compute[75026]: INFO nova.compute.manager [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Attaching volume 53242a55-a6ae-4b62-b4b4-a08b27028573 to /dev/vdb
Nov 10 20:21:27 user nova-compute[75026]: DEBUG os_brick.utils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[06da24be-f1d0-4b19-ab34-1aece8d1d809]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0641562-b148-4a8e-8a7b-040d1aa64513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4815e91a-7064-4e30-839e-c991ee3244aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fc7ff1-b294-47fb-a86d-df48c7d71767]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 20:21:27 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 20:21:27 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d88c1c-11de-4620-930b-4884c16939c0]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG os_brick.utils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:21:27 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating existing volume attachment record: b44a1d3c-cf94-4068-84b8-afa260b64a3e {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 20:21:30 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:55 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:21:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:21:55 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:21:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:21:55 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:21:55 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:21:55 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:21:56 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating instance_info_cache with network_info: [{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:21:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:21:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:21:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:21:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:21:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:22:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:22:00 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:22:00 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:22:00 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unveALBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:22:01 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:22:01 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:22:01 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8d8bd4-350c-4f34-8eea-c79651d1b594]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 20:22:01 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ca12d3-1e42-41ba-9404-5f7e6c94e8e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573] added
Nov 10 20:22:01 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f62aed3-2ce4-4c93-a921-13eff38f8187]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[47532168-2272-4416-8624-6ccc8b0f1a3b]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unveALBj {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unveALBj" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6332c63-addf-45c0-93e8-996f1a8dc8f6]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'unveALBj'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b4b2da-2cb7-4dcc-9013-ab112fd03d48]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c203a13-a42f-4252-af1b-9ef7382ca624]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 20:22:01 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 20:22:01 user nova-compute[75026]:  {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:22:01 user nova-compute[75026]: WARNING os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 20:22:01 user nova-compute[75026]: 
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd6738d-18c9-4a8e-849d-fd34a5d695b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573, portal: 172.16.0.220,3260]
Nov 10 20:22:01 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573, portal: 172.16.0.220,3260] successful.
Nov 10 20:22:01 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[267cf784-0bdb-4a3a-8cdf-a6527c625dd7]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:22:01 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:22:01 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.12311553955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1bc387-596e-48fe-b573-5c4ccb72233c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)
Nov 10 20:22:01 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)
Nov 10 20:22:01 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.611s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dbac33-8e22-4cd4-b86c-0bb57c4404b1]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unveALBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 922dcedc-1089-4a99-a3b5-0114c184f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:22:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:22:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.647s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:22:02 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== connect_volume: return (1649ms) {'type': 'block', 'scsi_wwn': '26662643037396135', 'path': '/dev/sdb'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:22:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662643037396135', 'path': '/dev/sdb'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 20:22:02 user nova-compute[75026]: DEBUG nova.objects.instance [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:22:02 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 20:22:02 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:22:02 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:22:02 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:22:02 user nova-compute[75026]:   <serial>53242a55-a6ae-4b62-b4b4-a08b27028573</serial>
Nov 10 20:22:02 user nova-compute[75026]: </disk>
Nov 10 20:22:02 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 20:22:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:22:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:22:03 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No VIF found with MAC fa:16:3e:6c:ab:44, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 20:22:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-1fdacc2b-6567-4d6c-a611-8aeb83af14ab tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.264s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:22:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:05 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:22:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:22:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:22:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:22:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:22:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:22:09 user nova-compute[75026]: INFO nova.compute.manager [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Attaching volume d60bc5cb-793d-44f3-b24c-f94d1100c0e6 to /dev/vdc
Nov 10 20:22:09 user nova-compute[75026]: DEBUG os_brick.utils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8a2a13-f602-4326-8b16-57952a0950a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af11b313c3cc\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0936e047-96d1-4de5-bad0-4c4f9f6fc803]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77683f4-2e4a-4d07-a96a-30b1d57f4aac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2512d2b3-6342-4243-a3ef-930f5c7af043]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Running cmd (subprocess): nvme version {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] 'nvme version' failed. Not Retrying. {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] nvme not present on system {{(pid=75026) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 20:22:09 user nova-compute[75026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 20:22:09 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bcb82e-d3f5-45a2-815c-3aaf66146294]: (4, '') {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75026) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.lightos [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] LIGHTOS: no hostnqn found. {{(pid=75026) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG os_brick.utils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af11b313c3cc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:22:09 user nova-compute[75026]: DEBUG nova.virt.block_device [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating existing volume attachment record: f24910cc-5fb5-424a-8cae-c7a676f06820 {{(pid=75026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 20:22:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:22:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:22:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:22:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:22:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Calling os-brick to attach iSCSI Volume {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaEnpIVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:22:32 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:22:32 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:22:32 user nova-compute[75026]: INFO os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb779b3f-296f-4241-b83e-cc36bfe80f1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 20:22:32 user nova-compute[75026]:  {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b62cffb-82c4-4b0e-aded-e0055870fc0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6] added\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6] added
Nov 10 20:22:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3066a2b-1cb1-464c-b5aa-fbcd962c6414]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea62b099-5201-461b-898f-834515fddb44]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaEnpIVR {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaEnpIVR" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5940c540-d000-4e1d-949f-c5a1c4a1d782]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaEnpIVR'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef1182-70e1-4cdb-a4a5-3f300ba3ffa5]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d67410f-fa45-47b7-a807-6bfc7afdc145]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)
Nov 10 20:22:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)
Nov 10 20:22:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --login {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a30bd5-9c45-4026-b042-94db0fc971dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6, portal: 172.16.0.220,3260]
Nov 10 20:22:32 user nova-compute[75026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6, portal: 172.16.0.220,3260] successful.
Nov 10 20:22:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c6a171-bfce-412e-bbce-e65bf22583c8]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc5167-dc68-4946-a050-10ea8327f690]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)
Nov 10 20:22:32 user nova-compute[75026]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)
Nov 10 20:22:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)
Nov 10 20:22:32 user nova-compute[75026]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)
Nov 10 20:22:32 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Connected to 172.16.0.220:3260 {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75026) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75026) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6541ba-39d5-4a28-9e08-34e11b257c83]: (4, ('- - 0', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75026) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 20:22:32 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaEnpIVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75026) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 20:22:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:22:33 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26332623339633637', 'path': '/dev/sdc'} {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:22:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332623339633637', 'path': '/dev/sdc'} {{(pid=75026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 20:22:33 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:22:33 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 20:22:33 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:22:33 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 20:22:33 user nova-compute[75026]:   <target dev="vdc" bus="virtio"/>
Nov 10 20:22:33 user nova-compute[75026]:   <serial>d60bc5cb-793d-44f3-b24c-f94d1100c0e6</serial>
Nov 10 20:22:33 user nova-compute[75026]: </disk>
Nov 10 20:22:33 user nova-compute[75026]:  {{(pid=75026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 20:22:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vda, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:22:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:22:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 20:22:34 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] No VIF found with MAC fa:16:3e:6c:ab:44, not building metadata {{(pid=75026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 20:22:34 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c8903ecb-e3cc-4a37-9942-83ebb41db5df tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.046s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:22:35 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:22:35 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:22:35 user nova-compute[75026]: INFO nova.compute.manager [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Detaching volume 53242a55-a6ae-4b62-b4b4-a08b27028573
Nov 10 20:22:35 user nova-compute[75026]: INFO nova.virt.block_device [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Attempting to driver detach volume 53242a55-a6ae-4b62-b4b4-a08b27028573 from mountpoint /dev/vdb
Nov 10 20:22:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Attempting to detach device vdb from instance 922dcedc-1089-4a99-a3b5-0114c184f799 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 20:22:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 20:22:35 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:22:35 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:22:35 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:22:35 user nova-compute[75026]:   <serial>53242a55-a6ae-4b62-b4b4-a08b27028573</serial>
Nov 10 20:22:35 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 20:22:35 user nova-compute[75026]: </disk>
Nov 10 20:22:35 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 20:22:35 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully detached device vdb from instance 922dcedc-1089-4a99-a3b5-0114c184f799 from the persistent domain config.
Nov 10 20:22:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 922dcedc-1089-4a99-a3b5-0114c184f799 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 20:22:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 20:22:35 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:22:35 user nova-compute[75026]:   <source dev="/dev/sdb"/>
Nov 10 20:22:35 user nova-compute[75026]:   <target dev="vdb" bus="virtio"/>
Nov 10 20:22:35 user nova-compute[75026]:   <serial>53242a55-a6ae-4b62-b4b4-a08b27028573</serial>
Nov 10 20:22:35 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 20:22:35 user nova-compute[75026]: </disk>
Nov 10 20:22:35 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 20:22:35 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 20:22:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:40 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:45 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:22:55 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 922dcedc-1089-4a99-a3b5-0114c184f799 is timed out.
Nov 10 20:22:55 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully detached device vdb from instance 922dcedc-1089-4a99-a3b5-0114c184f799 from the live domain config.
Nov 10 20:22:55 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unveALBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:22:55 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2cebdb-26db-4061-a3cb-8f2393fc971c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 20:22:55 user nova-compute[75026]: No targets found.
Nov 10 20:22:55 user nova-compute[75026]: iSNS:
Nov 10 20:22:55 user nova-compute[75026]: No targets found.
Nov 10 20:22:55 user nova-compute[75026]: STATIC:
Nov 10 20:22:55 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573
Nov 10 20:22:55 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 20:22:55 user nova-compute[75026]:                 Iface Name: default
Nov 10 20:22:55 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6
Nov 10 20:22:55 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 20:22:55 user nova-compute[75026]:                 Iface Name: default
Nov 10 20:22:55 user nova-compute[75026]: FIRMWARE:
Nov 10 20:22:55 user nova-compute[75026]: No targets found.
Nov 10 20:22:55 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 20:22:55 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 20:22:55 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b87dc-4df0-4b28-973e-85017ae68c33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84a7bf6-6fb8-4e9b-a577-354f2302672c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)
Nov 10 20:22:55 user nova-compute[75026]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)
Nov 10 20:22:55 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 (non-flash)
Nov 10 20:22:55 user nova-compute[75026]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)
Nov 10 20:22:55 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed80330790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573'): ({'sdb'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Removing single pathed devices sdb {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 20:22:55 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a74f03-9645-4b91-b1c3-989fe9ec8032]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e6a67e-0729-49a8-b2bc-35fa1000d52c]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flushing IO for device /dev/sdb {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[68088ee6-4fa6-45ce-8790-cb24604c1729]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[480c4a67-f233-4641-a3d3-f3e3829bf7e0]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] SCSI volumes sdb have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89ca537-ecc6-46db-a1af-2b0a32c98f61]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad758bf6-bfad-48bf-a443-14a13f3a0550]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573, portal: 172.16.0.220,3260]
Nov 10 20:22:56 user nova-compute[75026]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573, portal: 172.16.0.220,3260] successful.
Nov 10 20:22:56 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53242a55-a6ae-4b62-b4b4-a08b27028573 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e2262-7ce6-45b7-9b03-ff8772363bbb]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== disconnect_volume: return (276ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquired lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Forcefully refreshing network info cache for instance {{(pid=75026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG nova.objects.instance [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lazy-loading 'info_cache' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:22:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:22:57 user nova-compute[75026]: DEBUG nova.objects.instance [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:22:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-00ff0899-d2d7-418f-b240-474e74ef0e6c tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.788s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:22:57 user nova-compute[75026]: DEBUG nova.network.neutron [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating instance_info_cache with network_info: [{"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:22:57 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Releasing lock "refresh_cache-922dcedc-1089-4a99-a3b5-0114c184f799" {{(pid=75026) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:22:57 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updated the network info_cache for instance {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 20:22:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:22:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:22:58 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:22:58 user nova-compute[75026]: INFO nova.compute.manager [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Detaching volume d60bc5cb-793d-44f3-b24c-f94d1100c0e6
Nov 10 20:22:58 user nova-compute[75026]: INFO nova.virt.block_device [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Attempting to driver detach volume d60bc5cb-793d-44f3-b24c-f94d1100c0e6 from mountpoint /dev/vdc
Nov 10 20:22:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Attempting to detach device vdc from instance 922dcedc-1089-4a99-a3b5-0114c184f799 from the persistent domain config. {{(pid=75026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 20:22:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 20:22:58 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:22:58 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 20:22:58 user nova-compute[75026]:   <target dev="vdc" bus="virtio"/>
Nov 10 20:22:58 user nova-compute[75026]:   <serial>d60bc5cb-793d-44f3-b24c-f94d1100c0e6</serial>
Nov 10 20:22:58 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 20:22:58 user nova-compute[75026]: </disk>
Nov 10 20:22:58 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 20:22:58 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully detached device vdc from instance 922dcedc-1089-4a99-a3b5-0114c184f799 from the persistent domain config.
Nov 10 20:22:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 922dcedc-1089-4a99-a3b5-0114c184f799 from the live domain config. {{(pid=75026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 20:22:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.guest [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 20:22:58 user nova-compute[75026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 20:22:58 user nova-compute[75026]:   <source dev="/dev/sdc"/>
Nov 10 20:22:58 user nova-compute[75026]:   <target dev="vdc" bus="virtio"/>
Nov 10 20:22:58 user nova-compute[75026]:   <serial>d60bc5cb-793d-44f3-b24c-f94d1100c0e6</serial>
Nov 10 20:22:58 user nova-compute[75026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 20:22:58 user nova-compute[75026]: </disk>
Nov 10 20:22:58 user nova-compute[75026]:  {{(pid=75026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 20:22:58 user nova-compute[75026]: DEBUG nova.virt.libvirt.driver [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 20:22:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:23:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:23:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:23:02 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:23:02 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:23:02 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75026) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:23:03 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:23:03 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.113933563232422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Instance 922dcedc-1089-4a99-a3b5-0114c184f799 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:23:03 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:23:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:23:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:23:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:23:18 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 922dcedc-1089-4a99-a3b5-0114c184f799 is timed out.
Nov 10 20:23:18 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully detached device vdc from instance 922dcedc-1089-4a99-a3b5-0114c184f799 from the live domain config.
Nov 10 20:23:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] calling os-brick to detach iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fed982987c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaEnpIVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 20:23:18 user nova-compute[75026]: WARNING os_brick.initiator.connectors.base [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5db161-b28a-4f6c-9dd5-2fe0d521e71e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 20:23:18 user nova-compute[75026]: No targets found.
Nov 10 20:23:18 user nova-compute[75026]: iSNS:
Nov 10 20:23:18 user nova-compute[75026]: No targets found.
Nov 10 20:23:18 user nova-compute[75026]: STATIC:
Nov 10 20:23:18 user nova-compute[75026]: Target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6
Nov 10 20:23:18 user nova-compute[75026]:         Portal: 172.16.0.220:3260,-1
Nov 10 20:23:18 user nova-compute[75026]:                 Iface Name: default
Nov 10 20:23:18 user nova-compute[75026]: FIRMWARE:
Nov 10 20:23:18 user nova-compute[75026]: No targets found.
Nov 10 20:23:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 20:23:18 user nova-compute[75026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 20:23:18 user nova-compute[75026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75026) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6', 0)] {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[faabd7f3-4019-454b-89b1-886633533997]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3592ac23-0998-455c-a3a6-532de6a5ab4e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)
Nov 10 20:23:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 (non-flash)
Nov 10 20:23:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fed801bdb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6'): ({'sdc'}, set())}) {{(pid=75026) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Removing single pathed devices sdc {{(pid=75026) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3698ec1e-dbb3-425c-a8a1-4a0b681ecb0b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebcba59-e002-48b2-af08-3f8c2e3912a2]: (4, ('ok\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Flushing IO for device /dev/sdc {{(pid=75026) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e79001-806f-4c2d-84da-73b89d703941]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75026) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827294f-c8c3-43ff-b821-502043f6492b]: (4, ('1', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.linuxscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] SCSI volumes sdc have been removed. {{(pid=75026) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6')] {{(pid=75026) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61bf536-21d0-4ea8-a1cd-905fe45935d2]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --logout {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ee4536-8bf3-4fb2-ae39-f065f234c6c4]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6, portal: 172.16.0.220,3260]
Nov 10 20:23:18 user nova-compute[75026]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6, portal: 172.16.0.220,3260] successful.
Nov 10 20:23:18 user nova-compute[75026]:  stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op delete {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d60bc5cb-793d-44f3-b24c-f94d1100c0e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG oslo.privsep.daemon [-] privsep: reply[997dbd78-f009-4d85-8e67-511771695568]: (4, ('', '')) {{(pid=86097) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75026) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.base [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG os_brick.initiator.connectors.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] <== disconnect_volume: return (285ms) None {{(pid=75026) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 20:23:18 user nova-compute[75026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Disconnected iSCSI Volume {{(pid=75026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 20:23:19 user nova-compute[75026]: DEBUG nova.objects.instance [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'flavor' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:23:19 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-818fbff1-f6b3-400e-af65-407abf9e8db5 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.830s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:23:20 user nova-compute[75026]: INFO nova.compute.manager [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Terminating instance
Nov 10 20:23:20 user nova-compute[75026]: DEBUG nova.compute.manager [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Start destroying the instance on the hypervisor. {{(pid=75026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:20 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-00dce212-da9b-4c70-bb25-e389f6949f24 req-2d394641-5e16-474b-b065-5299b40424a1 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received event network-vif-unplugged-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-00dce212-da9b-4c70-bb25-e389f6949f24 req-2d394641-5e16-474b-b065-5299b40424a1 service nova] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-00dce212-da9b-4c70-bb25-e389f6949f24 req-2d394641-5e16-474b-b065-5299b40424a1 service nova] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-00dce212-da9b-4c70-bb25-e389f6949f24 req-2d394641-5e16-474b-b065-5299b40424a1 service nova] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-00dce212-da9b-4c70-bb25-e389f6949f24 req-2d394641-5e16-474b-b065-5299b40424a1 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] No waiting events found dispatching network-vif-unplugged-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.compute.manager [req-00dce212-da9b-4c70-bb25-e389f6949f24 req-2d394641-5e16-474b-b065-5299b40424a1 service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received event network-vif-unplugged-1c82ec2f-6594-4a24-980a-a42d262ec795 for instance with task_state deleting. {{(pid=75026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [-] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Instance destroyed successfully.
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.objects.instance [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lazy-loading 'resources' on Instance uuid 922dcedc-1089-4a99-a3b5-0114c184f799 {{(pid=75026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.virt.libvirt.vif [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T20:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-194785027',display_name='tempest-AttachVolumeTestJSON-server-194785027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-194785027',id=51,image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwkoWfcs/wzNq7ku2N7i9GJOhLvqOkcQfb3JQT3leGNpPjP2SG8fQpD+1RLSVr+iy4CHOZkgIe2qy++Em5VDpMQZd158REa18bdD0JlSLNWGYaa+wx8n53eCjLV8My7ow==',key_name='tempest-keypair-2001661709',keypairs=<?>,launch_index=0,launched_at=2023-11-10T20:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab34f478806f4280892268b11c3da88a',ramdisk_id='',reservation_id='r-camypv7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='da817026-309f-4431-a8d4-b6d8e64853b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636130646',owner_user_name='tempest-AttachVolumeTestJSON-636130646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T20:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3982ce75922144be8381f6dc9ee3f706',uuid=922dcedc-1089-4a99-a3b5-0114c184f799,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converting VIF {"id": "1c82ec2f-6594-4a24-980a-a42d262ec795", "address": "fa:16:3e:6c:ab:44", "network": {"id": "223ed02d-a2ef-4fca-b1e6-8668f0c4710e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1309880579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab34f478806f4280892268b11c3da88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c82ec2f-65", "ovs_interfaceid": "1c82ec2f-6594-4a24-980a-a42d262ec795", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.network.os_vif_util [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=1c82ec2f-6594-4a24-980a-a42d262ec795,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c82ec2f-65') {{(pid=75026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG os_vif [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=1c82ec2f-6594-4a24-980a-a42d262ec795,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c82ec2f-65') {{(pid=75026) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c82ec2f-65, bridge=br-int, if_exists=True) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2d1bcde-5a7c-46fb-8fb5-295202b0709e) {{(pid=75026) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:23:21 user nova-compute[75026]: INFO os_vif [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:ab:44,bridge_name='br-int',has_traffic_filtering=True,id=1c82ec2f-6594-4a24-980a-a42d262ec795,network=Network(223ed02d-a2ef-4fca-b1e6-8668f0c4710e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c82ec2f-65')
Nov 10 20:23:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Deleting instance files /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799_del
Nov 10 20:23:21 user nova-compute[75026]: INFO nova.virt.libvirt.driver [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Deletion of /opt/stack/data/nova/instances/922dcedc-1089-4a99-a3b5-0114c184f799_del complete
Nov 10 20:23:21 user nova-compute[75026]: INFO nova.compute.manager [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 20:23:21 user nova-compute[75026]: DEBUG oslo.service.loopingcall [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75026) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.compute.manager [-] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Deallocating network for instance {{(pid=75026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 20:23:21 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] deallocate_for_instance() {{(pid=75026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 20:23:22 user nova-compute[75026]: DEBUG nova.network.neutron [-] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Updating instance_info_cache with network_info: [] {{(pid=75026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 20:23:22 user nova-compute[75026]: INFO nova.compute.manager [-] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Took 0.71 seconds to deallocate network for instance.
Nov 10 20:23:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:23:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:23:22 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:23:22 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:23:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:23:22 user nova-compute[75026]: INFO nova.scheduler.client.report [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Deleted allocations for instance 922dcedc-1089-4a99-a3b5-0114c184f799
Nov 10 20:23:22 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-cab81f6a-e023-4d36-9846-3b147831ec04 tempest-AttachVolumeTestJSON-636130646 tempest-AttachVolumeTestJSON-636130646-project-member] Lock "922dcedc-1089-4a99-a3b5-0114c184f799" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:23:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-d5aa66c3-7f6c-415a-a290-f4ad48a9af8b req-cf6c5fe8-5667-4806-aa6a-158e7bd77e1a service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received event network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:23:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d5aa66c3-7f6c-415a-a290-f4ad48a9af8b req-cf6c5fe8-5667-4806-aa6a-158e7bd77e1a service nova] Acquiring lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:23:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d5aa66c3-7f6c-415a-a290-f4ad48a9af8b req-cf6c5fe8-5667-4806-aa6a-158e7bd77e1a service nova] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:23:23 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [req-d5aa66c3-7f6c-415a-a290-f4ad48a9af8b req-cf6c5fe8-5667-4806-aa6a-158e7bd77e1a service nova] Lock "922dcedc-1089-4a99-a3b5-0114c184f799-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:23:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-d5aa66c3-7f6c-415a-a290-f4ad48a9af8b req-cf6c5fe8-5667-4806-aa6a-158e7bd77e1a service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] No waiting events found dispatching network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 20:23:23 user nova-compute[75026]: WARNING nova.compute.manager [req-d5aa66c3-7f6c-415a-a290-f4ad48a9af8b req-cf6c5fe8-5667-4806-aa6a-158e7bd77e1a service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received unexpected event network-vif-plugged-1c82ec2f-6594-4a24-980a-a42d262ec795 for instance with vm_state deleted and task_state None.
Nov 10 20:23:23 user nova-compute[75026]: DEBUG nova.compute.manager [req-d5aa66c3-7f6c-415a-a290-f4ad48a9af8b req-cf6c5fe8-5667-4806-aa6a-158e7bd77e1a service nova] [instance: 922dcedc-1089-4a99-a3b5-0114c184f799] Received event network-vif-deleted-1c82ec2f-6594-4a24-980a-a42d262ec795 {{(pid=75026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 20:23:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 20:23:32 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] There are 0 instances to clean {{(pid=75026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 20:23:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:23:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:23:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:23:55 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:23:56 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:56 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 20:23:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:23:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:23:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:23:58 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 20:23:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:24:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:04 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:24:04 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:24:04 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:24:05 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:24:05 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9113MB free_disk=25.141033172607422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing inventories for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating ProviderTree inventory for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Updating inventory in ProviderTree for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing aggregate associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, aggregates: None {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Refreshing trait associations for resource provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90, traits: COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=75026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:24:05 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:24:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:24:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:06 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:24:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:24:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:24:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:24:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:32 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:24:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:24:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:50 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:24:57 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:59 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:24:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:24:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:24:59 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 20:25:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:25:01 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:25:05 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:25:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:25:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:25:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:25:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:25:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:25:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:25:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:25:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:25:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9132MB free_disk=25.139358520507812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:25:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:25:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:25:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:25:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:25:07 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:25:07 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:25:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:25:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:25:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:25:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:25:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:25:10 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:25:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:25:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:25:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:25:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:25:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:25:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:25:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:25:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:25:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:25:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:25:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:25:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:25:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:25:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:25:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:25:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:25:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:25:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:25:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:26:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:26:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 20:26:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:26:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:26:06 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:26:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:26:06 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:26:06 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:26:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:26:07 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:26:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9105MB free_disk=25.1373291015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:26:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:26:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:26:07 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:26:07 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:26:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:26:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:26:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:08 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:08 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:26:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:26:11 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:13 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:26:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:26:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:26:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:26:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:26:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:26:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:26:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:26:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:26:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:26:58 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:27:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:27:00 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 20:27:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:27:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:06 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:07 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:27:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:27:07 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:27:07 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Auditing locally available compute resources for user (node: user) {{(pid=75026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:27:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:27:08 user nova-compute[75026]: WARNING nova.virt.libvirt.driver [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:27:08 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Hypervisor/Node resource view: name=user free_ram=9115MB free_disk=25.13620376586914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:27:08 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:27:08 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:27:08 user nova-compute[75026]: DEBUG nova.compute.provider_tree [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed in ProviderTree for provider: 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 {{(pid=75026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:27:08 user nova-compute[75026]: DEBUG nova.scheduler.client.report [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Inventory has not changed for provider 0f7a5134-86ad-47cc-91e0-39a40ebb3a90 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:27:08 user nova-compute[75026]: DEBUG nova.compute.resource_tracker [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Compute_service record updated for user:user {{(pid=75026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:27:08 user nova-compute[75026]: DEBUG oslo_concurrency.lockutils [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=75026) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:27:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:09 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:27:09 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:11 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:27:12 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:14 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:27:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:27:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:27:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:27:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:27:16 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:21 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:26 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:27:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:27:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:27:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:27:31 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:36 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:27:38 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:41 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:46 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:27:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:27:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:27:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75026) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 20:27:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:27:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75026) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 20:27:51 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:27:56 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 20:28:00 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:28:01 user nova-compute[75026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75026) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 20:28:02 user nova-compute[75026]: DEBUG oslo_service.periodic_task [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75026) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:28:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Starting heal instance info cache {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:28:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Rebuilding the list of instances to heal {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:28:02 user nova-compute[75026]: DEBUG nova.compute.manager [None req-c0b6b3a2-5373-4347-aaea-0b2e7b4b7593 None None] Didn't find any instances for network info cache update. {{(pid=75026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}